English > Support
Dealing with movie duplicates
AimHere:
Hi,
I'm having a minor issue with duplication of movies in my database. Here's what's happening:
I like to maintain a [reasonably] complete filmography for each of the actors in my database. So, for each actor, I use the IMDB People plugin to import the filmography from IMDB. The plugin is set to overwrite filmographies, and "Merge filmography" selected in Preferences.
This works well enough most of the time. But occasionally, for certain movies, IMDB lists a different release year than the one I already have in my database record for that movie. This causes the actor's filmography to have TWO entries with that movie title, one for the complete movie record I already had, and another linking to an "invisible" movie record with the release year from IMDB.
Now, I can usually get rid of the duplicate entry by editing my "complete" movie record to match the release year from IMDB (this has the effect of merging the two records, as long as the titles match exactly). Occasionally, though, I also have to take the additional step of clicking on the imported IMDB title in the actor's filmography to make the movie record visible in Movies View, then holding down the CTRL key while deleting it.
What I'd like to know is, is there a simple way to scan through all of my actor filmographies to find these duplicates? Right now, I'm dealing with them as I notice them, but I suspect there are a ton more I haven't found yet. I don't know if the "Delete movie duplicates" in "Tools/Optimoze Database" will do what I want, and I'd rather not risk having it delete any "complete" movie records.
Aimhere
rick.ca:
--- Quote ---The plugin is set to overwrite filmographies, and "Merge filmography" selected in Preferences.
--- End quote ---
Why do you have "Merge filmography" selected? If it wasn't, running the plugin would fix the problem by replacing everything with the person's current filmography.
--- Quote ---IMDB lists a different release year than the one I already have in my database record for that movie.
--- End quote ---
Why are they different?
--- Quote ---I don't know if the "Delete movie duplicates" in "Tools/Optimize Database" will do what I want, and I'd rather not risk having it delete any "complete" movie records.
--- End quote ---
I believe the only way that could happen is if both records are visible. That's not the case in the scenario you describe. But if you're concerned about that possibility, you can still run the utility with the option to remove only invisible records.
AimHere:
--- Quote from: rick.ca on December 28, 2010, 11:52:18 pm ---
--- Quote ---The plugin is set to overwrite filmographies, and "Merge filmography" selected in Preferences.
--- End quote ---
Why do you have "Merge filmography" selected? If it wasn't, running the plugin would fix the problem by replacing everything with the person's current filmography.
--- End quote ---
What happens if I don't have "merge filmography" selected, and I have a movie in my database that ISN'T in IMDB's filmography? (IMDB isn't always complete, after all.) What happens to my movie record? Would the actor's filmography in PVD continue to list that movie, even if it wasn't found on IMDB? Or would the filmography omit it, thus disconnecting the movie from the actor? I thought that's what "Merge filmographies" was supposed to prevent?
--- Quote ---
--- Quote ---IMDB lists a different release year than the one I already have in my database record for that movie.
--- End quote ---
Why are they different?
--- End quote ---
Because I import most of the movie info (posters/box art, studio, descriptions, etc.) from another source, AdultDVDEmpire. (In this genre, IMDB rarely has any info other than the title and cast.) And the two sources just happen to disagree on release year.
In my typical workflow, I'll add a movie, import the movie info from ADE, confirm the list of cast members, go to each cast member in turn, and update the person's filmography from IMDB. It's that last step that's giving me the duplicate movies in the filmography, when ADE and IMDB disagree on the release year.
--- Quote ---
--- Quote ---I don't know if the "Delete movie duplicates" in "Tools/Optimize Database" will do what I want, and I'd rather not risk having it delete any "complete" movie records.
--- End quote ---
I believe the only way that could happen is if both records are visible. That's not the case in the scenario you describe. But if you're concerned about that possibility, you can still run the utility with the option to remove only invisible records.
--- End quote ---
"Delete movie duplicates" (unlike "Delete movie orphans") doesn't have an option to only remove invisible records.
Okay, as a test I made a copy of my database, then ran "Optimize database" with "Delete movie duplicates" selected. It did delete some 300+ movies. Unfortunately, it removed eight (out of 2009) visible movie records, e.g. movies that were legitimately in my collection. I don't know why this would happen, I'm certain I didn't have any actual duplicates. It's possible there may have been a couple of movies (from different studios) with identical titles, but whenever I run across those, I add the studios to the titles to avoid confusion...
Aimhere
rick.ca:
--- Quote ---I thought that's what "Merge filmographies" was supposed to prevent?
--- End quote ---
Yes, not using that option results in the existing filmography being replaced. The only good reason for using it is the situation you didn't describe at first. The cause of your issue is the inconsistency in data between two sources.
--- Quote ---And the two sources just happen to disagree on release year.
--- End quote ---
Before updating the people, update the movie with the IMDb plugin set to overwrite Title and Year, and to not change credits.
--- Quote ---"Delete movie duplicates" (unlike "Delete movie orphans") doesn't have an option to only remove invisible records.
--- End quote ---
I know that. I was only stating what I believe based on my experience. I've never noticed it delete a visible movie. You could export before and after lists of visible moves and compare those in Excel to determine what was deleted. That should indicate why the deletions are happening.
AimHere:
--- Quote from: rick.ca on December 30, 2010, 08:34:18 pm ---I've never noticed it delete a visible movie. You could export before and after lists of visible moves and compare those in Excel to determine what was deleted. That should indicate why the deletions are happening.
--- End quote ---
Okay, did before-and-after exports, and compared them. PVD deleted eight out of 2022 visible movie records. I can't find any rhyme or reason why it would think they are duplicates, either. Looking at my "before" database, the movies all have proper titles and "original titles", all unique as far as I can tell. (A couple are parts of series, e.g. "Some Movie", "Some Movie 2", etc., but they shouldn't be considered duplicates.)
I wonder if we could get Nostra to weigh in on the methodology used to determine whether movies are duplicates?
Aimhere
Navigation
[0] Message Index
[#] Next page
Go to full version