Author Topic: [SOLVED] Import from IMDB Not Working  (Read 99358 times)

0 Members and 1 Guest are viewing this topic.

buah

  • Guest
Re: Import from IMDB Not Working
« Reply #80 on: September 24, 2010, 10:29:53 pm »
I don't seem Country and Original language data to get.

Movie: Frozen (2010/I)

Offline nostra

  • Administrator
  • *****
  • Posts: 2852
    • View Profile
    • Personal Video Database
Re: Import from IMDB Not Working
« Reply #81 on: September 24, 2010, 11:25:37 pm »
Fixed in 0.9.5.3. Oh man, when will they finally stop changing stuff?!
Gentlemen, you can’t fight in here! This is the War Room!

buah

  • Guest
Re: Import from IMDB Not Working
« Reply #82 on: September 25, 2010, 12:13:45 am »
Thanks, nostra.

P.S. I don't think they will ever stop changing stuff. The way provides 'em at least a lot more clicks...

Offline rick.ca

  • Global Moderator
  • *****
  • Posts: 3241
  • "I'm willing to shoot you!"
    • View Profile
Re: Import from IMDB Not Working
« Reply #83 on: September 25, 2010, 12:31:43 am »
Oh man, when will they finally stop changing stuff?!

That's why I asked...

I'm wondering what we might expect as the IMDb redesign rolls out. Does your fix involve parsing the new main page, or finding the old one? And will further changes be required as they convert other pages?

From their description of the roll-out process, it sounds like this could go on for months. If the plugin is intelligently figuring out which page version it's being sent too and parsing accordingly, maybe that's not a problem. Otherwise, this will get even worse as they start changing all the subsidiary pages (i.e., keywords, fullcredits, awards, business, technical)—and using both versions of those at the same time. :-\

Offline nostra

  • Administrator
  • *****
  • Posts: 2852
    • View Profile
    • Personal Video Database
Re: Import from IMDB Not Working
« Reply #84 on: September 25, 2010, 01:01:32 am »
Quote
If the plugin is intelligently figuring out which page version it's being sent too and parsing accordingly, maybe that's not a problem

It does, but they still manage to change stuff in the new design, so I can't do anything about it :(
Well, we just need to be patient and wait until they have finished. 
Gentlemen, you can’t fight in here! This is the War Room!

buah

  • Guest
Re: Import from IMDB Not Working
« Reply #85 on: September 25, 2010, 01:07:18 am »
In a way I see this as a challenge for all movie manager software, and as a chance for PVD to get a lot of new users...

Offline rick.ca

  • Global Moderator
  • *****
  • Posts: 3241
  • "I'm willing to shoot you!"
    • View Profile
Re: Import from IMDB Not Working
« Reply #86 on: September 25, 2010, 02:10:36 am »
Well, we just need to be patient and wait until they have finished.

Assuming, then, we'll be seeing a series of issues that will require changes to the plugin, is there any specific information users can report about those issues that will help you? We could start a new topic that explains the situation, and asks users to report their observations in the most helpful way. Do you need logs, examples, page.html files, etc.? Or would a report that awards data is not being downloaded (for example) imply clearly enough those pages are beginning to be affected?

I wonder if there's another forum we can monitor to give us a head's up on what's happening.

Offline Hyomil

  • User
  • ***
  • Posts: 96
    • View Profile
Re: Import from IMDB Not Working
« Reply #87 on: September 30, 2010, 11:43:30 am »
Looks like another one here: using the new 0.3.0.0 People plugin, I just updated Jeffrey Lau http://imdb.com/name/nm0311508, who I already had some movies of in my database, and PVD created new entries for them instead of merging like it used to.  None of these new entries have years, either.  (See attached screenshot.)  

In addition to not merging the credits, PVD didn't import all of them to begin with.  I tested on a copy of the database where I cleared the Jeffrey Lau record and reimported and the first entry under each category is missing.

Writer:
1.  Chut sui fu yung (2010) is missing.
Director:
1.  Chut sui fu yung (2010) is missing.
Producer:
1.  Kung Fu Hustle (2004) is missing.
Actor:
1.  Yuet gwong bo hup (2010) is missing.

And for the ones that did import, the years were missing.

I haven't made any changes to the plugin's settings recently; "Merge Filmography" is checked and "Filmography" has a black (not gray) checkmark.

Code: [Select]
(9/30/2010 2:41:03 AM) Logging in...
(9/30/2010 2:41:03 AM) POST: http://www.imdb.com/register/login
(9/30/2010 2:41:03 AM) Redirected to: https://secure.imdb.com/register-imdb/login
(9/30/2010 2:41:03 AM) Person -> LoadStatic -> 0ms
(9/30/2010 2:41:03 AM) Person -> LoadMultivalues -> 0ms
(9/30/2010 2:41:03 AM) Person -> LoadFilms -> 15ms
(9/30/2010 2:41:03 AM) Person -> LoadAwards -> 0ms
(9/30/2010 2:41:03 AM) Person -> LoadImages -> 0ms
(9/30/2010 2:41:03 AM) Searching person information for: Jeffrey Lau
(9/30/2010 2:41:03 AM) GET: http://imdb.com/name/nm0311508
(9/30/2010 2:41:03 AM) Redirected to: http://www.imdb.com/rg/parked-domains/imdb.com/name/nm0311508
(9/30/2010 2:41:03 AM) Redirected to: http://www.imdb.com/name/nm0311508
(9/30/2010 2:41:03 AM) Redirected to: http://www.imdb.com/name/nm0311508/
(9/30/2010 2:41:06 AM) GET: http://www.imdb.com/name/nm0311508/awards
(9/30/2010 2:41:09 AM) Person -> LoadStatic -> 0ms
(9/30/2010 2:41:09 AM) Person -> LoadMultivalues -> 0ms
(9/30/2010 2:41:09 AM) Person -> LoadFilms -> 0ms
(9/30/2010 2:41:09 AM) Person -> LoadAwards -> 16ms
(9/30/2010 2:41:09 AM) Person -> LoadImages -> 0ms
(9/30/2010 2:41:44 AM) UpdateToolbar: 46
(9/30/2010 2:41:44 AM) UpdateToolbar: 47
(9/30/2010 2:42:02 AM) UpdateToolbar: 48
(9/30/2010 2:42:02 AM) UpdateToolbar: 49
(9/30/2010 2:42:02 AM) Person -> LoadStatic -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadMultivalues -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadFilms -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadAwards -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadImages -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadStatic -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadMultivalues -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadFilms -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadAwards -> 0ms
(9/30/2010 2:42:02 AM) Person -> LoadImages -> 0ms
(9/30/2010 2:42:17 AM) UpdateToolbar: 50
(9/30/2010 2:42:17 AM) UpdateToolbar: 51
(9/30/2010 2:42:32 AM) UpdateToolbar: 52
(9/30/2010 2:42:32 AM) UpdateToolbar: 53
(9/30/2010 2:42:32 AM) Person -> LoadStatic -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadMultivalues -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadFilms -> 16ms
(9/30/2010 2:42:32 AM) Person -> LoadAwards -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadImages -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadStatic -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadMultivalues -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadFilms -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadAwards -> 0ms
(9/30/2010 2:42:32 AM) Person -> LoadImages -> 0ms
(9/30/2010 2:50:44 AM) Person -> LoadStatic -> 0ms
(9/30/2010 2:50:44 AM) Person -> LoadMultivalues -> 0ms
(9/30/2010 2:50:44 AM) Person -> LoadFilms -> 0ms
(9/30/2010 2:50:44 AM) Person -> LoadAwards -> 0ms
(9/30/2010 2:50:44 AM) Person -> LoadImages -> 0ms
(9/30/2010 2:51:24 AM) UpdateToolbar: 54
(9/30/2010 2:51:24 AM) UpdateToolbar: 55

PVD 0.9.9.21
Windows 7 64-bit

[attachment deleted by admin]
« Last Edit: September 30, 2010, 11:46:47 am by Hyomil »

Offline rick.ca

  • Global Moderator
  • *****
  • Posts: 3241
  • "I'm willing to shoot you!"
    • View Profile
Re: Import from IMDB Not Working
« Reply #88 on: September 30, 2010, 11:45:21 pm »
Quote
I haven't made any changes to the plugin's settings recently; "Merge Filmography" is checked and "Filmography" has a black (not gray) checkmark.

Notwithstanding this should work properly, why do you have "Merge Filmography" checked? What happens if it's not checked?

Offline nostra

  • Administrator
  • *****
  • Posts: 2852
    • View Profile
    • Personal Video Database
Re: Import from IMDB Not Working
« Reply #89 on: October 01, 2010, 12:18:36 am »
You are right, Hyomil, thx for the info. I have uploaded a fix.
Gentlemen, you can’t fight in here! This is the War Room!

Offline Hyomil

  • User
  • ***
  • Posts: 96
    • View Profile
Re: Import from IMDB Not Working
« Reply #90 on: October 01, 2010, 01:49:22 am »
...why do you have "Merge Filmography" checked?...

Because I didn't read your post in this thread.   :)  I'll leave it unchecked.

You are right, Hyomil, thx for the info. I have uploaded a fix.

Thanks, that works for the credits, but now an import for the same person (Jeffrey Lau http://imdb.com/name/nm0311508), fails to get the Alternative Names and Genres.

Also, for Jeeja Yanin http://imdb.com/name/nm2925876, I tried importing (with "Merge Filmography" unchecked) and PVD removed the 2 movies I already had in my database (presumably because I had Filmography as a black rather than gray checkbox, which I've changed now as well) and didn't add them back upon importing a second time.

Offline nostra

  • Administrator
  • *****
  • Posts: 2852
    • View Profile
    • Personal Video Database
Re: Import from IMDB Not Working
« Reply #91 on: October 01, 2010, 02:33:32 am »
Quote
Alternative Names and Genres.

I could not find those in the new design...
Gentlemen, you can’t fight in here! This is the War Room!

Offline Hyomil

  • User
  • ***
  • Posts: 96
    • View Profile
Re: Import from IMDB Not Working
« Reply #92 on: October 01, 2010, 03:01:05 am »
Quote
Alternative Names and Genres.

I could not find those in the new design...

With the new design, Alternative names are on the main page for me (see attached screenshot) and genres are on this page:

http://www.imdb.com/name/nm0311508/filmogenre

Also, are you able to import the 2 credits for Jeeja Yanin http://imdb.com/name/nm2925876?  I get nothing when I try to import them.

[attachment deleted by admin]

Offline rick.ca

  • Global Moderator
  • *****
  • Posts: 3241
  • "I'm willing to shoot you!"
    • View Profile
Re: Import from IMDB Not Working
« Reply #93 on: October 01, 2010, 08:54:13 pm »
A few minor issues with the movie info plugin are illustrated in the attached screen shot...

  • I've seen the missing space in the actor data before and assumed the problem was at the source. With the latest version, it does it to all actors in all series, while the data appears okay at IMDb.

  • Votes has been without a thousands separator since it was introduced.

[attachment deleted by admin]

Offline nostra

  • Administrator
  • *****
  • Posts: 2852
    • View Profile
    • Personal Video Database
Re: Import from IMDB Not Working
« Reply #94 on: October 03, 2010, 11:42:25 pm »
Quote
With the new design, Alternative names are on the main page for me (see attached screenshot)

OK, got them

Quote
and genres are on this page:
http://www.imdb.com/name/nm0311508/filmogenre

I think genres are not important enough for people to download an extra page.

Quote
Also, are you able to import the 2 credits for Jeeja Yanin http://imdb.com/name/nm2925876?  I get nothing when I try to import them.

Fixed

Quote
With the latest version, it does it to all actors in all series, while the data appears okay at IMDb.

Fixed

Quote
# Votes has been without a thousands separator since it was introduced.

It has nothing to do with the plugin. I need to improve the field behavior in the main app.
Gentlemen, you can’t fight in here! This is the War Room!

Offline rick.ca

  • Global Moderator
  • *****
  • Posts: 3241
  • "I'm willing to shoot you!"
    • View Profile
Re: Import from IMDB Not Working
« Reply #95 on: October 04, 2010, 03:04:39 am »
Quote
I've seen the missing space in the actor data before and assumed the problem was at the source. With the latest version, it does it to all actors in all series, while the data appears okay at IMDb.

Now the information in parentheses is gone completely. :'(

In edit mode, I see there's a now a space between the role and comma-separator, so it seems the parenthetical part has simply been omitted.

Offline nostra

  • Administrator
  • *****
  • Posts: 2852
    • View Profile
    • Personal Video Database
Re: Import from IMDB Not Working
« Reply #96 on: October 04, 2010, 05:13:00 pm »
Do you really need it? Looks kind of ugly...
Gentlemen, you can’t fight in here! This is the War Room!

Offline rick.ca

  • Global Moderator
  • *****
  • Posts: 3241
  • "I'm willing to shoot you!"
    • View Profile
Re: Import from IMDB Not Working
« Reply #97 on: October 04, 2010, 09:16:32 pm »
Quote
Do you really need it? Looks kind of ugly...

Perhaps, but the information is essential. It is, after all, a summary of episode data, and not all actors have been with the series for the same period. Attached is an illustration from my series record for NYPD Blue (1993-2005). The information is particularly useful when looking back at an older series.

The screen shot illustrates another use. The last two entries are there as a result of PVD's unfortunate behaviour of adding people to movie records when they are updated in People View, even if the people there are restricted to "main page only." Such entries appearing tell me it's time to update the record to fix that problem. I would prefer, of course, if that weren't necessary in the first place. People should not be added to movie credits when the "Show people added from movie credits" option has been selected.

I'd be happy if you abbreviated the information. For example...

Hugh Laurie ... Dr. Gregory House (135x|2004-) instead of
Hugh Laurie ... Dr. Gregory House (135 episodes - 2004-2010)

...but some might think that even uglier. :-\

[attachment deleted by admin]

Offline nostra

  • Administrator
  • *****
  • Posts: 2852
    • View Profile
    • Personal Video Database
Re: Import from IMDB Not Working
« Reply #98 on: October 05, 2010, 12:41:04 am »
OK, I'll add an option for this info.
Gentlemen, you can’t fight in here! This is the War Room!

Offline nostra

  • Administrator
  • *****
  • Posts: 2852
    • View Profile
    • Personal Video Database
Re: Import from IMDB Not Working
« Reply #99 on: October 06, 2010, 01:26:07 am »
OK, I'll add an option for this info.

Done
Gentlemen, you can’t fight in here! This is the War Room!