English > Support
[SOLVED] Multi threaded IMDB fetching?
patch:
--- Quote from: rick.ca on August 28, 2010, 06:05:42 am ---So do you think running multiple versions of the program, each simultaneously running the plugin, would be a valid test of whether IMDb would tolerate this kink of hammering?
--- End quote ---
From an accessed site perspective what is suggested will demand the same or less than the current approach so the risk is low there.
The concurrency happens at different web sites.
Running multiple versions of PVD partially tests a much higher risk implementation imo.
--- Quote ---
--- Quote ---As such documenting program use instructions in a forum is the opposite to what we need.
--- End quote ---
I, of course, disagree with this. We have a wiki. It doesn't seem to be used much, and there's quite obviously no one with any interest in contributing to it. So the evidence seems to be to the contrary.
--- End quote ---
The suggestion was to address nostra's observation that the perceived PVD complexity is a significant barrier to a new novice user.
--- Quote ---Unfortunately it seems like many users have difficulties when starting using PVD.
--- End quote ---
I agree we all tend to be more interested in addressing issues relevant to what we do. Unfortunately the issues are different for the novice compared to a regular forum contributer.
The form is a good way to explore new and complex problems.
It is not a good guide for a first time user who just want to try out PVD to see if it meets there needs. Many will walk away.
So we interpret the evidence differently.
rick.ca:
--- Quote ---The concurrency happens at different web sites.
--- End quote ---
If you're suggesting concurrent download of different movies from IMDb (or perhaps concurrent download of the various different pages of one movie) is not feasible, then it doesn't seem worthwhile to pursue the idea further.
--- Quote ---The suggestion was to address nostra's observation that the perceived PVD complexity is a significant barrier to a new novice user.
--- End quote ---
I understand why the comment was made. To suggest the forum is good for some things and not others just doesn't make any sense. It seems we've proven a wiki not integrated the software's home (this forum) doesn't work very well. The fact it offers more features and a format more convenient for software documentation is pointless if it's not going to be used. Just like the idea of tutorials, manuals, help files and videos is pointless if no one is going to create them. But if anyone does care to create any of these things, they can be posted here—where they will get the most exposure and can be integrated with everything else that goes on here.
--- Quote ---It is not a good guide for a first time user who just want to try out PVD to see if it meets there needs.
--- End quote ---
Why not? If a well-written tutorial would do the trick, such a thing (or a collection of such things) can just as easily be posted here as anywhere else. And here, new users—who are going to have difficulties regardless of good the "documentation" is—can ask questions and get help for their specific issues. And if no one has the time or inclination to create a formal help document, forum discussions themselves will provide a reasonable alternative. I always try to answer questions in way that will help others reading the exchange (at the time or later) will benefit as well. I hope you're not suggesting I'm wasting my time. :o
--- Quote ---Many will walk away.
--- End quote ---
Of course they will. So what? You have no evidence of who, how many, why or what would make any difference. Maybe more would walk away if they tried some clear instruction and still had difficulty. They might reasonably conclude there's something wrong with the software, or it's just not for them. Who knows? Maybe that's what's happening to many who go only to the wiki for help—while those who come here learn from others the program is a challenge to learn, but mainly because of it's power and flexibility. I believe the first and most important thing any user who is ever likely to develop a serious interest in this software needs to learn is that it is worth their while to learn it. The only credible source for that information is personal advice of other experienced users—reinforced by their own experience. It seems to me this forum is the perfect means for facilitating that.
Happy2k:
From my point of view, then all there is needed, is a "Getting started tutorial". It should contain:
- How to scan folders for movies
- How to fix movies like Transporter 2 and 3 being grouped as episodes
- How to update info
- How to add a movie if the auto-detect got no correct results
- How to run silent mode, and search for skipped movies
- How to import posters located in the same folder as the movie itself
- How to customize the export (found the template list via google - couldnt find it anywhere here)
- How to add series
- How to get it to display the episode titles correctly
Just my 5 cent :)
rick.ca:
--- Quote ---From my point of view, then all there is needed, is a "Getting started tutorial". It should contain...
--- End quote ---
That, more or less, is the intent behind the Help Index. Anyone is welcome to post a tutorial there. Feel free to use an edited version of a post or thread found elsewhere, or excerpts from the wiki. Add a link to that topic at the top, and give it a meaningful "How to" title. I'll add each such post to the index (i.e., the first post). That's getting a bit messy, but I'd be happy to redo that if there's more content.
An advantage to this approach is that we can openly discuss and collaborate on the creation of such tutorials right in that thread. Users who have difficulty following a tutorial can say so right there. Others could then help them and suggest improvements to the tutorial at the same time. Such posts would probably need to be moved to separate topics (or a "Help Index Discussion" topic) after each discussion is over, but that's easy to do.
nostra:
--- Quote ---1) Run different plugins / web site queries in parallel. By this I mean if for a movie you are getting information from imdb, allmovie, and amazon then the sites could be accessed in series but the 3 sites could be accessed in parallel by overlapping accesses for different movies. Implementing this would probably mean calling different plugins from different tasks with a queue between each so involve considerable change to the plugin calling code but less changes to to individual plugins. Maximum speed up of x3 for 3 plugins run in parallel.
--- End quote ---
I am afraid that running multiple different plugins will be too difficult to implement and also could cause such problems as user not exactly knowing of is happening or user getting 3 movie selection windows simultaneously. I do think that a plugin that downloads all the pages it needs from the same source at the same time would work much faster if the source allows. Such a system is also not too difficult to implement, but you will need to update the plugin to support multithreading.
--- Quote ---2) Only information which is going to be actually stored in PVD could be downloaded. By this I mean PVD could look at the field flags set for the plugin and the data already in PVD and determine what pages actually need to be downloaded for each website - PVD movie update. The speed benefit would be minimal when initially populating an empty PVD movie record from the first web site, so would be no faster than 1) for a mass movie import but maybe a lot faster for later incremental updates to an established PVD database. From a coding perspective it would be a major change to the plugin architecture with each plugin being passed information on which fields need to be filled, them each plugin being code to selectively download web pages as required for each PVD movie record update. So it implies a re-write of each plugin for which selective access is practical and considerable changes to the plugin calling code.
--- End quote ---
The speed benefit will be too low to consider
--- Quote ---From my point of view, then all there is needed, is a "Getting started tutorial". It should contain:
- How to scan folders for movies
- How to fix movies like Transporter 2 and 3 being grouped as episodes
- How to update info
- How to add a movie if the auto-detect got no correct results
- How to run silent mode, and search for skipped movies
- How to import posters located in the same folder as the movie itself
- How to customize the export (found the template list via google - couldnt find it anywhere here)
- How to add series
- How to get it to display the episode titles correctly
Just my 5 cent Smiley
--- End quote ---
+
--- Quote ---1) Wiki should open on a contents and search page focused on PVD not the wiki engine.
2) Clear simplistic tutorials for basic initial set up tasks.
3) Let advanced users have to burrow through multiple pages to get to relevant things for them rather than beginners. As such documenting program use instructions in a forum is the opposite to what we need.
--- End quote ---
I think, I will implement some kind of tutorial or online help in version 1. Do not have time for 1 and 3.
--- Quote ---Maybe we should try to make videos on specific issues from now on? The one who resolved the issue could make a video tutorial for it, or someone else who's willing to. New "Video Tutorials" board would be established in such purpose...
--- End quote ---
I think it is a good idea. Any volunteers?
Navigation
[0] Message Index
[#] Next page
[*] Previous page
Go to full version