English > Support
Personal Video Database 1.0.2.7 MOD
Ivek23:
IMDB_[EN][HTTPS]_(Connections) script
IMDB_[EN][HTTPS] (Connections) script is now renamed to IMDB_[EN][HTTPS]_(Connections) script and now this is the final version of the script.
--- Quote from: Ivek23 on October 28, 2018, 01:41:31 pm ---IMDB_[EN][HTTPS] (Connections) script
I've edited the MOD version of IMDB_ [EN] [HTTPS] script, which is now called IMDB_ [EN] [HTTPS] (Connections) script to transfer the Movie Connections information to the Normal Connections PVD field.
An additional code has also been added to transfer the category, which is allowed to record
url titles in the Connections custom box for links to the Connections website. In the Connections custom field, your data record will look like this,
--- Quote ---Followed by (2) Version of (58) Spin-off (1) References (6) Referenced in (27) Features (1) Featured in (1) Spoofs (1) Spoofed in (2)
--- End quote ---
it will also have a visible option in the record, clicking on it, in order to open the Internet window of this record in the web browser.
In case of only such a record,
--- Quote ---Spin-off (1)
--- End quote ---
there will be no url link to the Connections website.
--- End quote ---
I've done this by fixing a link to a specific IMDb Movie Connections website in the Custom Connections field. Custom Connections field still has links to individual categories and how many records are in each category. Where there is only one category where no link has been made so far, it is now a direct link to a particular IMDb Movie Connections website.
New is now the Connect Custom Box, where you can now set the PVD view so that you can now see the categories and the number of movie titles and which movie addresses are in a particular category [for example, the following number of movie titles are followed: Follows (10) ].
--- Quote --- 5. Connections field info names:
• Follows
• Followed_by
• Version_of
• Remake_of
• Remade_as
• Edited_from
• Edited_into
• Spin_off_from (Spun_off_from)
• Spin_off
• References
• Referenced_in
• Features
• Featured_in
• Spoofs
• Spoofed_in
--- End quote ---
These are all categories whose information can be transferred to the PVD database. Missing category " Alternate-language version of ", because I have noticed this category so far or found it with only one movie title.
--- Quote --- GET_FULL_CONNECTIONS = True ; //Download Connections provider page for retreive the MovieConnections info. Otherwise no info of the Connections provider page.
--- End quote ---
If you change this function, there is no transfer of any information.
--- Quote --- GET_FULL_CONNECT = False ; //Download Connections provider page for retreive the Follows, Followed_by, Version_of, Remake_of, Remade_as, Edited_from, Edited_into, Spin_off_from(Spun_off_from) and Spin_off info. Otherwise set to True to only the Follows and Followed by info of the Connections provider page.
--- End quote ---
If you change this function, the transfer of information will only be for the Follows and Followed by the info of the Connections provider page. You must also use the lower function you can not change, otherwise some other categories will be downloaded.
--- Quote --- GET_FULL_CONNECTION = True ; //Download Connections provider page for retreive the Follows, Followed_by, Version_of, Remake_of, Remade_as, Edited_from, Edited_into, Spin_off_from(Spun_off_from) and Spin_off info of the Connections provider page. Otherwise set to False to the full MovieConnections info.
--- End quote ---
If you change this feature, you will be transferring all the information on the Connections provider page.
--- Quote ---Notice:
This function is basic set flagged-blocked with a " True " word.
--- End quote ---
--- Quote ---Footnote:
You can change the functions according to your preferences, of course.
--- End quote ---
--- Quote --- CONNECT_LIMIT = 100; //Limit of number of connections retrieved.
--- End quote ---
The limit is basic set to the 100 records, because there may be several records in the same category as the limit is set. This number allows the script to run faster, although records may also be several times higher.
Also, filtering records with this part of the code is added, which allows the database to be visible only for movies and movies with the TV Movie tag in the normal OrigTitle PVD field.
--- Quote ---If Pos('(Empty)',Title) OR Pos('(TV Episode)',OrigTitle) OR Pos('(TV Series)',OrigTitle) OR Pos('(TV Mini-Series)',OrigTitle) OR Pos('(Short)',OrigTitle) OR Pos('(TV Short)',OrigTitle) OR Pos('(TV Special)',OrigTitle) OR Pos('(Video Game)',OrigTitle) OR Pos('(Video)',OrigTitle) < 1 then
--- End quote ---
The following categories have such a filter:
--- Quote --- • Remake_of
• Remade_as
• Edited_into
• Spin_off_from (Spun_off_from)
• References
• Referenced_in
• Features
• Featured_in
• Spoofs
• Spoofed_in
--- End quote ---
The following categories have in the database in addition to already visible records for movies and movies with the TV Movie tag as well as the TV Series tag in the normal OrigTitle PVD field.
--- Quote --- • Version_of
• Edited_from
--- End quote ---
The following categories have in the database in addition to already visible records for movies and movies with the TV Movie tag as well as the TV Series and Video tag in the normal OrigTitle PVD field.
--- Quote --- • Follows
• Followed_by
• Spin_off
--- End quote ---
IMDB_ [EN] [HTTPS]_(Connections) script is attached.
Ivek23:
IMDB_ [EN] [HTTPS]_(Connections) script
Notice:
--- Quote from: Ivek23 on November 23, 2018, 08:45:49 am ---I added the OrigTitle code, which is essential for filtering records at all and does not change. In the Connection field, the notes will also have a year (for example, For Your Eyes Only (1981)), which is written only in the Original Title field, but not in the Titile field in the PVD database. This option is added so that you often see multiple identical titles of the title of a movie, but the years of the movie outcome are different. This is removed at that time (movie year) when you update the movie record and the Original Title checkbox is confirmed.
--- End quote ---
The complete code in IMDB_ [EN] [HTTPS] _ (Connections) script for downloading Connections information should not be added to the original IMDB_ [EN] [HTTPS] script, because it will greatly slow down the performance of the script. IMDB_ [EN] [HTTPS] _ (Connections) script should remain as user only an additional script that will be used only by those users who will, at their option, want to download Connections information in their PVD Movies database.
Ivek23:
IMDB_[EN][HTTPS] (Connections) script
--- Quote from: Ivek23 on December 02, 2018, 04:08:43 pm ---
--- Quote from: VVV_Easy_Programing on December 02, 2018, 10:41:08 am ---I'm going to integrate the retreive of Plotkeywords in the base script of IMDB (although 100 seem to me many) and Connections when you tell me it is ready.
Now I do not have much time, but it is first in my ToDo list.
--- End quote ---
Recommendation:
Yes, Plotkeywords in the base script of IMDB and Connections as a secondary script.
--- End quote ---
I mentioned this because, for example, The Spy Who Loved Me movie title had a problem and IMDB_ [EN] [HTTPS] (Connections) script did not find a Connections website, but it always reported that the page or url of the address could not be found. The Connections web page url, however, was passed through a specific part of the code to the custom field, which proved that the page actually exists. Then I found a part of the code
--- Quote ---Function DownloadPage(URL:AnsiString):String; //BlockOpen
//Returns the URL page text. If error returns empty string
Var
i:Integer;
ScriptPath,WebText:String;
Begin
.
.
.
if (Pos('404 Error - IMDb',Result)>0) then begin //Banned IP. WEB_SPECIFIC.
If BYPASS_SILENT Then ShowMessage('The URL is not in use (404 Error - IMDb).'+Chr(13)+'Go to the provider web in order to in order to'+Chr(13)+'find the good page',SCRIPT_NAME);
LogMessage(Chr(9)+Chr(9)+' 404 Error - IMDb|');
Result:=''; //Fatal error
End;
//if (Pos('Page not found',Result)>0) then begin //Banned IP. WEB_SPECIFIC.
// If BYPASS_SILENT Then ShowMessage('The URL is not in use (Page not found).'+Chr(13)+'Go to the provider web in order to in order to'+Chr(13)+'find the good page',SCRIPT_NAME);
// LogMessage(Chr(9)+Chr(9)+' Page not found|');
// Result:=''; //Fatal error
//End;
if (Pos('405 Method not allowed',Result)>0) then begin //Banned IP. WEB_SPECIFIC.
If BYPASS_SILENT Then ShowMessage('The URL has HTTP method problems (405 Method not allowed).'+Chr(13)+'Go to the provider web in order to in order to'+Chr(13)+'find the good page',SCRIPT_NAME);
LogMessage(Chr(9)+Chr(9)+' 405 Method not allowed|');
Result:=''; //Fatal error
End;
.
.
.
LogMessage(Chr(9)+Chr(9)+'Function DownloadPage END======================|');
exit;
End; //BlockClose
--- End quote ---
that prevented the detection of the website and I blocked it. The result of blocking this part of the code was that the IMDB_ [EN] [HTTPS] (Connections) script worked properly and correctly downloaded the data for this movie from the Connections website.
Ivek23:
IMDB_ [EN] [HTTPS] script
Minor changes to the code.
--- Quote ---Function ParsePage_IMDBMovieBASE(HTML:String):Cardinal; //BlockOpen
//Returns:
// Result:=prFinished; Script has finished gathering data
// Result:=prError; If żany big problem? with exit;
//Retrieve: ~title~, ~year~, ~origtitle~, ~poster~ / ~imdbrating~, ~IMDB_Votes~ (Custom Field) / ~TOP_250~(Custom Field) /
// If Not(GET_FULL_CREDIT): ~crew~ctDirectors,ctWriters,ctComposers,ctProducers(Not in base page), ctActors
// ~description~ / ~category~ "keywords" / ~tagline~ / ~genre~
// If Not(GET_FULL_MPAA) ~mpaa~
// ~country~ / ~rdate~ in contry provider local IP geolocation
// If Not(GET_FULL_AKA) ~aka~.
// ~budget~ / ~money~ / ~studio~ "Production Co"
// If Not(GET_FULL_FEATURES) ~features~
Var
curPos,endPos,index:Integer;
ItemValue1,ItemValue,ItemList,ImageFile:String;
titleValue:String;
Name,Role,PersonURL:String;
ItemArray:TWideArray;
Begin
LogMessage('Function ParsePage_IMDBMovieBASE BEGIN======================|');
Result:=prFinished; //It will change to prError if any big problem with exit;
//Because the script don't retreives the data in the page order a token search for the first curPos position or block select is mandatory
//Get ~title~, ~year~, ~origtitle~, ~poster~
//Get all "raw" title summary (in raw because we need the hidden links, we avoid "complete" token in strings which opens/closes)
ItemList:=TextBetWeenFirst(HTML,'<div class="title_block"','div class="plot_summary_wrapper">'); //WEB_SPECIFIC.
If (Length(ItemList)>0) Then Begin
titleValue:=TextBetWeenFirst(ItemList,'<h1 class="">','<'); //Strings which opens/closes the data. WEB_SPECIFIC
If titleValue = '0' then titleValue:='';
If titleValue = '' then titleValue:=TextBetWeenFirst(ItemList,'<h1 class="long">','<'); //Strings which opens/closes the data. WEB_SPECIFIC
AddFieldValueXML('title',titleValue);
LogMessage(' Get result title:'+titleValue+'||');
ItemValue:=TextBetWeenFirst(ItemList,'<span id="titleYear">(',')</span> </h1>'); //Strings which opens/closes the data. WEB_SPECIFIC
AddFieldValueXML('year',ItemValue);
LogMessage(' Get result year:'+ItemValue+'||');
endPos:=PosFrom('title="See more release dates" >',ItemList,curPos);
curPos:=PosFrom('title="See more release dates" >',ItemList,endPos);
endPos:=PosFrom('</a> </div>',ItemList,curPos);
curPos:=curPos+43;
ItemValue1:=Copy(ItemList,curPos,4);
LogMessage(' Get result year00:'+ItemValue1+'||');
ItemValue1:=StringReplace(ItemValue1,'/a> ','',True,False,True);
if ItemValue1 <> '' then AddFieldValueXML('year',ItemValue1);
if ItemValue1 <> '' then LogMessage(' Get result year0:'+ItemValue1+'||');
ItemValue:=TextBetWeenFirst(ItemList,'<div class="originalTitle">','<'); //Strings which opens/closes the data. WEB_SPECIFIC
If (Length(ItemValue)=0) Then ItemValue:=titleValue; //Provider hides the original title if same that title. WEB_SPECIFIC
AddFieldValueXML('origtitle',ItemValue);
LogMessage(' Get result origtitle:'+ItemValue+'||');
ItemValue:=TextBetWeenFirst(ItemList,BASE_URL_IMAGE_PRE_TRUE,'.'); //Get poster code. Strings which opens/closes the data. WEB_SPECIFIC
If (Length(ItemValue)>0) then begin
ItemValue:=BASE_URL_IMAGE_PRE_TRUE + ItemValue; //Base poster URL without '.jpg'. WEB_SPECIFIC
ImageFile:=GetAppPath+'Scripts\'+BASE_DOWNLOAD_FILE_IMAGE_NAME+'-Poster.jpg'
// Avoid HTTPS redirection: Download https image to file OutPutFile=
If (1=DownloadImage(ItemValue + '._V1_UY' + IntToStr(MAX_IMAGE_HEIGTH) + '_.jpg',ImageFile)) then begin //Dowload in the selected user max size. WEB_SPECIFIC
//AddImageURL(itPoster,ImageFile); //Get the photo from a file even if the next line we log the true URL.
LogMessage(' Get result poster:'+ItemValue + '._V1_UY' + IntToStr(MAX_IMAGE_HEIGTH) + '_.jpg'+'||');
end else if (1=DownloadImage(ItemValue +'.jpg',ImageFile)) then begin //Dowload in the web base size. WEB_SPECIFIC
//AddImageURL(itPoster,ImageFile); //Get the photo from a file even if the next line we log the true URL.
LogMessage(' Get result poster:' + ItemValue + '.jpg'+'||');
end;
end;
End;
--- End quote ---
--- Quote --- //Get ~script info~
//Get ~rdate~ in contry provider local IP geolocation. See: http://sobizarre-en.blogspot.fr/2014/12/how-to-easily-defeat-imdb-geolocation.html
//Get ~imdbrating~, ~IMDB_Votes~ (Two tries)
ItemList:=TextBetWeenFirst(HTML,'<script type="application/ld+json"','}</script>'); //WEB_SPECIFIC.
If (Length(ItemList)>0) Then Begin
ItemValue:=TextBetWeenFirst(ItemList,'"@type": "','",'); //Strings which opens/closes the data. WEB_SPECIFIC
ItemValue:=StringReplace(ItemValue,'TVSeries','TV Series',True,False,True);
ItemValue:=StringReplace(ItemValue,'TVEpisode','TV Episode',True,False,True);
//AddCustomFieldValueByName('IMDBMovietype',ItemValue);
//LogMessage(' Get result MediaType (CF~IMDBMovietype~):'+ItemValue+'||');
MediaType:=StringReplace(ItemValue,'TVSeries','TV Series',True,False,True);
MediaType:=StringReplace(ItemValue,'TVEpisode','TV Episode',True,False,True);
AddCustomFieldValueByName('IMDB_Movietype',MediaType);
LogMessage(' Get result MediaType (CF~IMDB_Movietype~):'+MediaType+'||');
ItemValue:=TextBetWeenFirst(ItemList,'"contentRating": "','",'); //Strings which opens/closes the data. WEB_SPECIFIC
AddCustomFieldValueByName('IMDB_MPAA',ItemValue);
if ItemValue <> '' then LogMessage(' Get result ContentRating (CF~IMDB_MPAA~):'+ItemValue+'||');
ImageFile:=TextBetWeenFirst(ItemList,'"image": "','._V1_.jpg",')+'._V1_UY'+IntToStr(MAX_IMAGE_HEIGTH)+'_.jpg';
AddImageURL(itPoster,ImageFile);
LogMessage(' Get result poster:' + ImageFile +'||');
ItemValue1:=TextBetWeenFirst(ItemList,'"datePublished": "','-');
//AddFieldValueXML('year',ItemValue1);
LogMessage(' Get result year01:'+ItemValue1+'||');
ItemValue:=TextBetWeenFirst(ItemList,'"datePublished": "','",'); //Strings which opens/closes the data. WEB_SPECIFIC
ItemValue:=StringReplace(ItemValue,'-01','-1',True,False,True);
ItemValue:=StringReplace(ItemValue,'-02','-2',True,False,True);
ItemValue:=StringReplace(ItemValue,'-03','-3',True,False,True);
ItemValue:=StringReplace(ItemValue,'-04','-4',True,False,True);
ItemValue:=StringReplace(ItemValue,'-05','-5',True,False,True);
ItemValue:=StringReplace(ItemValue,'-06','-6',True,False,True);
ItemValue:=StringReplace(ItemValue,'-07','-7',True,False,True);
ItemValue:=StringReplace(ItemValue,'-08','-8',True,False,True);
ItemValue:=StringReplace(ItemValue,'-09','-9',True,False,True);
if ItemValue <> '' then LogMessage(' Get result ReleaseDatePublished: '+ItemValue+' ||');
if ItemValue <> '' then begin
ExplodeString(ItemValue,ItemArray,'-');
ItemValue:=ItemArray[2]+'.'+ ItemArray[1]+'.'+ItemArray[0];
AddFieldValueXML('rdate',ItemValue);
AddCustomFieldValueByName('IMDB Release Date',ItemValue);
if ItemValue <> '' then LogMessage(' Get result DatePublished ~rdate~ (CF~IMDB Release Date~):'+ItemValue+'||');
End;
ItemValue:=TextBetWeenFirst(ItemList,'"ratingCount": ',','); //Strings which opens/closes the data. WEB_SPECIFIC
AddCustomFieldValueByName('IMDB_Votes',ItemValue);
if ItemValue <> '' then LogMessage(' Get result ratingCount (~IMDB_Votes~): '+ItemValue+' ||');
ItemValue:=TextBetWeenFirst(ItemList,'"ratingValue": "','"'); //Strings which opens/closes the data. WEB_SPECIFIC
AddFieldValueXML('imdbrating',ItemValue);
AddCustomFieldValueByName('IMDB Rating',ItemValue);
AddCustomFieldValueByName('IMDBRating',ItemValue);
if ItemValue <> '' then LogMessage(' Get result ratingValue ~imdbrating~ (CF~IMDB Rating~~IMDBRating~): '+ItemValue+' ||');
End;
--- End quote ---
Ivek23:
IMDB_ [EN] [HTTPS] script
Minor changes to the code.
--- Quote --- //Get "plot_summary" as ~comment~ (In the PVD check fields table selection only ~description~ can be checked for overwrite but the user can change the config and
// write ~description~ in ~comment~ so with the script parameter we Avoid double use of ~description~ and ~comment~.
If Not(PRESERVE_PVD_DESCRIPTION_SETTING) Then Begin
curPos:=Pos('<div class="plot_summary',HTML); //WEB_SPECIFIC.
If 0<curPos then begin
curPos:=Pos('<div class="summary_text">',HTML); //WEB_SPECIFIC.
If 0<curPos Then Begin
//ItemValue:=TextBetWeen(HTML,'<div class="summary_text">','</div>',false,curPos); //Strings which opens/closes the data. WEB_SPECIFIC
ItemValue:=TextBetWeen(HTML,'<div class="summary_text','</div>',false,curPos); //Strings which opens/closes the data. WEB_SPECIFIC
curPos:=Pos(' <a href="',ItemValue);
If 0<curPos then ItemValue:=Copy(ItemValue,0,curPos-1);
ItemValue:=StringReplace(ItemValue,', ',', ',True,False,True);
ItemValue:=StringReplace(ItemValue,' ',' ',True,False,True);
ItemValue:=StringReplace(ItemValue,' ',' ',True,False,True);
ItemValue:=StringReplace(ItemValue,'Add a Plot »','',True,False,True);
ItemValue:=StringReplace(ItemValue,'See full summary »','',True,False,True);
ItemValue:=StringReplace(ItemValue,'">','',True,False,True);
curPos:=Pos('var ue_t0=ue_t0||+new Date();var ',ItemValue);
If 0<curPos then ItemValue:=Copy(ItemValue,0,curPos-1);
AddFieldValueXML('comment',ItemValue);
LogMessage(' Get result "Plot_summary" as ~comment~:'+ItemValue+'||');
End;
End;
End;
--- End quote ---
New part of the added code.
--- Quote ---//USER FUNCTIONS AND PROCEDURES==================================================================================BlockClose
//OBLIGATORY CALLBACK PRINCIPAL FUNCTION=========================================================================BlockOpen
Function ParsePage(HTML:String;URL:AnsiString):Cardinal; //BlockOpen
Var
MovieID,titleValue,yearValue:String;
ResultTmp:Cardinal;
Date:String;
Fullinfo,Movie_URL,IMDB_URL: String;
DateParts: TWideArray;
Begin
.
.
.
//Parse with the Movie URL 'smNormal'------------------------------------------------------------------------------------
If (Mode=smNormal) Then Begin
//Get the script Overwrite Options saved in pvdconf.ini (Remember that PVD only save the options on exit)
//0=Do nothing,1=Set if Empty,2=Overwrite
PVDConfigOptions:=TextBetWeenFirst(FileToString(GetAppPath+'pvdconf.ini'),'IMDB_[EN][HTTPS].psf=',Chr(13));
//LogMessage('Stored Script PVDConfigOptions is:'+PVDConfigOptions+'||');
//LogMessage('The Script option of position '+ IntToStr(opPoster) +' is:'+Copy(PVDConfigOptions,opPoster,1)+'||');
Result:=prFinished; //It will change to prError if any big problem with exit;
//Information in several page. Needs Provider MovieID
MovieID:=TextBetWeenFirst(DownloadURL,BASE_URL_PRE_TRUE,BASE_URL_SUF);
LogMessage(' ParsePage mode smNormal|'+IntToStr(Mode)+'|. Getting provider data for MovieID|'+ MovieID +'|');
AddCustomFieldValueByName('IMDbID',MovieID);
LogMessage(' Get result IMDbID (CF~IMDbID~):'+MovieID+'||');
//Get ~url~
if (0=Pos(BASE_URL_PRE,StoredURL)) then begin //Write the url if not exists
AddFieldValueXML('url',StringReplace(DownloadURL,BASE_URL_PRE_TRUE,BASE_URL_PRE,True,False,False));
LogMessage(' Get result url:'+StringReplace(DownloadURL,BASE_URL_PRE_TRUE,BASE_URL_PRE,True,False,False)+'||');
end;
//Get ~IMDb Movie Url~
Movie_URL:=StringReplace(DownloadURL,BASE_URL_PRE_TRUE,BASE_URL_PRE,True,False,False);
LogMessage(' Get result Movie_url: '+Movie_URL+' ||');
Fullinfo:='';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'">Maindetails</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'reference">Reference</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'fullcredits">Full Cast&Crew</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'awards">Awards</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'releaseinfo">ReleaseDates</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'technical">TechnicalSpecs</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'parentalguide">ParentsGuide</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'keywords">PlotKeywords</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'plotsummary">PlotSummary</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'locations">FilmLocations</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'taglines">Taglines</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'companycredits">CompanyCredits</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'movieconnections">Connections</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'soundtrack">Soundtracks</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'externalsites">Miscellaneous</link> ';
Fullinfo:=Fullinfo+'<link url="'+Movie_URL+'mediaindex">PhotoGallery</link>';
If Fullinfo <> '' then IMDB_URL:=Fullinfo;
If IMDB_URL <> '' then AddCustomFieldValueByName('IMDb Movie Url',IMDB_URL);
LogMessage(' Get result Fullinfo-IMDB_URL (CF~IMDb Movie Url~ ):'+#13+IMDB_URL+'||');
//Parse principal provider page = BASE_URL_PRE_TRUE------------------------------------------------------------------
--- End quote ---
Navigation
[0] Message Index
[#] Next page
[*] Previous page
Go to full version