Personal Video Database
English => Support => Topic started by: afrocuban on December 08, 2021, 09:16:11 pm
-
In all IMDB_ [EN] [HTTPS], IMDB_ [EN] (HTTPS] (series) and IMDB_ [EN] [HTTPS] (episodes) scripts, Runtime information is now incorrectly downloaded. The reason is a change in the source code of the primary Imdb web pages. I have fixed this bug and all Imdb scripts may be added to the forum tonight or tomorrow.
I have a custom field Run time for runtime. In IMDB_ [EN] [HTTPS] I added
AddCustomFieldValueByName('Run time',ItemValue);
I did analog in IMDB_ [EN] (HTTPS] (series) by adding
1104 AddCustomFieldValueByName('Run time',ItemValue1);
but for some reason it doesn't work.
Since the only way to record actual media length in PVD is to record it to Duration field, I'd prefer IMDb length to be recorded to a custom field Run time
Any help on this, please?
EDIT:
If I put
1111 AddCustomFieldValueByName('Run time',ItemValue00);
I get length 1 hour for https://www.imdb.com/title/tt8694364/, but not 60 minutes???
-
Also, IMDB_Series-year custom field doesn't import category and year as it did until recent layout changes.
-
I will edit AllMovie scripts first, then I will edit your requests and problems with Imdb scripts.
-
In all IMDB_ [EN] [HTTPS], IMDB_ [EN] (HTTPS] (series) and IMDB_ [EN] [HTTPS] (episodes) scripts, Runtime information is now incorrectly downloaded. The reason is a change in the source code of the primary Imdb web pages. I have fixed this bug and all Imdb scripts may be added to the forum tonight or tomorrow.
I have a custom field Run time for runtime. In IMDB_ [EN] [HTTPS] I added
AddCustomFieldValueByName('Run time',ItemValue);
I did analog in IMDB_ [EN] (HTTPS] (series) by adding
1104 AddCustomFieldValueByName('Run time',ItemValue1);
but for some reason it doesn't work.
Since the only way to record actual media length in PVD is to record it to Duration field, I'd prefer IMDb length to be recorded to a custom field Run time
Any help on this, please?
EDIT:
If I put
1111 AddCustomFieldValueByName('Run time',ItemValue00);
I get length 1 hour for https://www.imdb.com/title/tt8694364/, but not 60 minutes???
For afrocuban
In IMDB_ [EN] [HTTPS] script it is necessary to change the Runtime code in Function ParsePage_IMDBMovieBASE.
//Get the original "Runtime" (in minutes) as ~length~ (in seconds) instead of the duration of the user movie copy
StartPos:=Pos('<span class="ipc-metadata-list-item__label">Runtime</span>',HTML);
if StartPos>0 then begin
Hours:=StrToInt(HTMLValue(HTML,StartPos,0,'<div class="ipc-metadata-list-item__content-container">','<!-- --> <!-- -->hour'));
Minutes:=StrToInt(HTMLValue(HTML,StartPos,0,'hour<!-- --> <!-- -->','<!-- --> <!-- -->minutes'));
ItemValue:=IntToStr(Hours*60 + Minutes);
If ItemValue = '0' then ItemValue:='';
If ItemValue = '' then Minutes:=StrToInt(HTMLValue(HTML,StartPos,0,'<div class="ipc-metadata-list-item__content-container">','<!-- --> <!-- -->minutes'));
ItemValue:=IntToStr(Hours*60 + Minutes);
//LogMessage('duration: '+ItemValue);
if ItemValue <> '' then LogMessage(' Get result Original Runtime:'+ItemValue+'||');
//AddFieldValueXML('duration', ItemValue);
AddFieldValueXML('length',IntToStr(60*StrToInt(ItemValue))); //~length~ Value in seconds.
if ItemValue <> '' then AddCustomFieldValueByName('Run time1',ItemValue);
if ItemValue <> '' then LogMessage(' Get result lenght:'+ItemValue+'||');
end else
LogMessage('duration not found');
Function ParsePage_IMDBMovieTECHNICAL
is such a code for the "Run time" custom field.
//Get "Runtime" info
curPos:=Pos('<td class="label"> Runtime </td>',HTML); //WEB_SPECIFIC.
If 0<curPos Then Begin
ItemValue:=TextBetWeen(HTML,' (',' min)',false,curPos); //Strings which opens/closes the data. WEB_SPECIFIC
//Get the original "Runtime" (in minutes) as ~length~ instead of the duration of the user movie copy
AddFieldValueXML('length',IntToStr(60*StrToInt(ItemValue))); //~length~ Value in seconds.
//AddFieldValue(14,ItemValue); //Field number 14 = Duration, value in minutes
if ItemValue <> '' then AddCustomFieldValueByName('Run time',ItemValue);
if ItemValue <> '' then LogMessage(' Get result lenght from Original Runtime:'+ItemValue+'||');
End;
LogMessage('Function ParsePage_IMDBMovieTECHNICAL END=====================||');
For IMDB_ [EN] [HTTPS] (episodes) script
V Function ParsePage_IMDBMovieTECHNICAL is such a code for the "Run time" custom field. //Get "Runtime" info
curPos:=Pos('<td class="label"> Runtime </td>',HTML); //WEB_SPECIFIC.
If 0<curPos Then Begin
ItemValue0:=TextBetWeen(HTML,' (',' min)',false,curPos); //Strings which opens/closes the data. WEB_SPECIFIC
//Get the original "Runtime" (in minutes) as ~length~ instead of the duration of the user movie copy
AddFieldValueXML('length',IntToStr(60*StrToInt(ItemValue0))); //~length~ Value in seconds.
//AddFieldValue(14,ItemValue); //Field number 14 = Duration, value in minutes
if ItemValue0 <> '' then AddCustomFieldValueByName('Run time',ItemValue0);
if ItemValue0 <> '' then LogMessage(' Get result lenght from Original Runtime:'+ItemValue0+'||');
End;
//Get "Runtime" info
curPos:=Pos('<td class="label"> Runtime </td>',HTML); //WEB_SPECIFIC.
If 0<curPos Then Begin
ItemValue1:=TextBetWeen(HTML,'<td>',' min',false,curPos); //Strings which opens/closes the data. WEB_SPECIFIC
//Get the original "Runtime" (in minutes) as ~length~ instead of the duration of the user movie copy
AddFieldValueXML('length',IntToStr(60*StrToInt(ItemValue1))); //~length~ Value in seconds.
//AddFieldValue(14,ItemValue); //Field number 14 = Duration, value in minutes
if ItemValue1 <> '' then AddCustomFieldValueByName('Run time1',ItemValue1);
if ItemValue1 <> '' then LogMessage(' Get result lenght from Original Runtime0:'+ItemValue1+'||');
End;
LogMessage('Function ParsePage_IMDBMovieTECHNICAL END=====================||');
Here are two pieces of code for "RUNTIME" information transfer. Both are needed. that there will always be information transfer. if the Runtime record is present in the Technical Specifications web pages.
And this one.
The "runtime" custom fields here may be named differently because I wrote them them that way because of the tests, if the information is transmitted correctly.
Therefore, each user should change the names of the custom fields that they already use now.
-
For afrocuban
However, in the IMDB_ [EN] (HTTPS) (series) script, several pieces of code need to be changed.
In Function ParsePage_IMDBMovieBASE, the following pieces of code change.
Function ParsePage_IMDBMovieBASE(HTML:String):Cardinal; //BlockOpen
//Returns:
// Result:=prFinished; Script has finished gathering data
// Result:=prError; If żany big problem? with exit;
//Retrieve: ~title~, ~year~, ~origtitle~, ~poster~ / ~imdbrating~, ~IMDB_Votes~ (Custom Field) / ~TOP_250~(Custom Field) /
// If Not(GET_FULL_CREDIT): ~crew~ctDirectors,ctWriters,ctComposers,ctProducers(Not in base page), ctActors
// ~description~ / ~category~ "keywords" / ~tagline~ / ~genre~
// If Not(GET_FULL_MPAA) ~mpaa~
// ~country~ / ~rdate~ in contry provider local IP geolocation
// If Not(GET_FULL_AKA) ~aka~.
// ~budget~ / ~money~ / ~studio~ "Production Co"
// If Not(GET_FULL_FEATURES) ~features~
Var
curPos,endPos,index:Integer;
debug_pos1:Integer;
StartPos:Integer;
//Hours,Minutes:Integer;
ItemValue,ItemValue0,ItemValue1,ItemValue2,ItemList,ImageFile:String;
ItemValue00:String;
titleValue:String;
yearValue:String;
seriesValue,yearsValue:String;
Name,Role,PersonURL:String;
ItemList2,ItemList12,day_s,month_s,year_s:String;
//ItemList1,ItemList11:String;
ItemArray:TWideArray;
Begin
.
.
.
//Go to "Tv Mode"
StartPos:=Pos('<h1 textlength="',HTML);
if StartPos>0 then begin
ItemValue:=HTMLValue(HTML,StartPos,0,'<li role="presentation" class="ipc-inline-list__item">','releaseinfo?ref_=tt_ov_rdat');
if ItemValue <> '' then LogMessage(' Get result Tv Mode1:'+ItemValue+'||');
debug_pos1:=Pos('<a href="',ItemValue);
if debug_pos1 >0 then ItemValue:=Copy(ItemValue,0,debug_pos1-1);
//ItemValue:=StringReplace(ItemValue,'','',True,False,True);
//ItemValue:=StringReplace(ItemValue,'</a>','',True,False,True);
AddCustomFieldValueByName('Tv',ItemValue);
if ItemValue <> '' then LogMessage(' Get result Tv Mode (CF~Tv~):'+ItemValue);
if Pos('TV Mini Series',ItemValue)>0 then yearsValue:=yearsValue+'TV Mini Series ';
if Pos('TV Series',ItemValue)>0 then yearsValue:=yearsValue+'TV Series ';
if yearsValue <> '' then LogMessage(' Get result yearsValue:'+yearsValue);
//ItemValue1:=HTMLValue(HTML,StartPos,0,'<li role="presentation" class="ipc-inline-list__item','</ul>');
ItemValue1:=HTMLValues(HTML,'<h1 textlength="','</ul>','"ipc-inline-list__item">','</',', ',StartPos);
//ItemValue1:=HTMLValues2(HTML,'<h1 textlength="','</ul>','<li role="presentation" class="ipc-inline-list__item">','</li>',', ',StartPos);
AddCustomFieldValueByName('Tv2',ItemValue1);
if ItemValue1 <> '' then LogMessage(' Get result Tv Mode01:'+#13+ItemValue1+'||'+#13);
end else
LogMessage('tv-metadata not found');
//Go to "Tv Mode" Series-year
StartPos:=Pos('releaseinfo?ref_=tt_ov_rdat',HTML);
if StartPos>0 then begin
yearValue:=HTMLValue(HTML,StartPos,0,'</a>','</span></li><li role="presentation" class="ipc-inline-list__item"><a href="/title/');
//AddCustomFieldValueByName('IMDB_year',yearValue);
//AddCustomFieldValueByName('IMDB Year',yearValue);
AddCustomFieldValueByName('IMDB_Series-year',yearValue);
if yearsValue <> '' then seriesValue:=yearsValue+'('+yearValue+')' else seriesValue:='';
AddCustomFieldValueByName('IMDB_Series-year1',seriesValue);
if seriesValue <> '' then LogMessage(' Get result seriesValue:'+#13+seriesValue+'||'+#13);
if yearValue <> '' then LogMessage(' Get result Tv Mode (CF~IMDB_year~)+:'+yearValue);
end else
LogMessage('tv-metadata-a not found');
.
.
.
//Get the original "Runtime" (in minutes) as ~length~ (in seconds) instead of the duration of the user movie copy //WEB_SPECIFIC.
curPos:=Pos('<span class="ipc-metadata-list-item__label">Runtime</span>',HTML); //WEB_SPECIFIC.
If 0<curPos Then Begin
ItemValue1:=TextBetWeen(HTML,'<div class="ipc-metadata-list-item__content-container">','minutes</div></li>',false,curPos); //Strings which opens/closes the data. WEB_SPECIFIC
//ItemList:=ItemList+'Original Runtime: '+ItemValue1+' min.<br>';
LogMessage(' Get result Original Runtime11:'+ItemValue1+'||');
//If GET_FULL_FEATURES Then
if ItemValue1 <> '' then
AddFieldValueXML('length',IntToStr(60*StrToInt(ItemValue1))); //~length~ Value in seconds.
if ItemValue1 <> '' then AddCustomFieldValueByName('Run time1',ItemValue1);
//AddFieldValue(14,ItemValue1); //Field number 14 = Duration, value in minutes
if ItemValue1 <> '' then LogMessage(' Get result lenght011:'+ItemValue1+'||');
//LogMessage(' Get result lenght012:'+HTMLValues(HTML,'<span class="ipc-metadata-list-item__label">Runtime</span>','</ul>','<li role="presentation" class="ipc-inline-list__item">','</li>',', ',endPos)+'||');
ItemValue00:=TextBetWeen(HTML,'<div class="ipc-metadata-list-item__content-container">','hour</div></li>',false,curPos); //Strings which opens/closes the data. WEB_SPECIFIC
LogMessage(' Get result Original Runtime111:'+ItemValue00+'||');
if ItemValue00 <> '' then
AddFieldValueXML('length',IntToStr(3600*StrToInt(ItemValue00))); //~length~ Value in seconds.
if ItemValue00 <> '' then AddCustomFieldValueByName('Run time1',IntToStr(60*StrToInt(ItemValue00)));
if ItemValue00 <> '' then LogMessage(' Get result Original Runtime111:'+ItemValue00+'||');
if ItemValue00 <> '' then LogMessage(' Get result lenght0111:'+ItemValue00+'||');
End;
For a possible error in the code part for the series, you can also add it yourself or report the problem and I added it.
And this one.
The "runtime" and "IMDB_Series-year" custom fields here may be named differently because I wrote them them that way because of the tests, if the information is transmitted correctly.
Therefore, each user should change the names of the custom fields that they already use now.
-
Thank you Ivek. I will try this!
-
Thank you Ivek. I will try this!
OK, we’re waiting for your news on how this works for you.
-
Dear Ivek, here I am with the feedback.
Everything works perfect, and I admit I wasn't expected that, because of lot of code to change.
The only thing that doesn't work for me is Runtime for series. This piece of code doesn't import run time for me, although I renamed custom field to Run time instead of Run time1
//Get the original "Runtime" (in minutes) as ~length~ (in seconds) instead of the duration of the user movie copy //WEB_SPECIFIC.
curPos:=Pos('<span class="ipc-metadata-list-item__label">Runtime</span>',HTML); //WEB_SPECIFIC.
If 0<curPos Then Begin
ItemValue1:=TextBetWeen(HTML,'<div class="ipc-metadata-list-item__content-container">','minutes</div></li>',false,curPos); //Strings which opens/closes the data. WEB_SPECIFIC
//ItemList:=ItemList+'Original Runtime: '+ItemValue1+' min.<br>';
LogMessage(' Get result Original Runtime11:'+ItemValue1+'||');
//If GET_FULL_FEATURES Then
if ItemValue1 <> '' then
AddFieldValueXML('length',IntToStr(60*StrToInt(ItemValue1))); //~length~ Value in seconds.
if ItemValue1 <> '' then AddCustomFieldValueByName('Run time1',ItemValue1);
//AddFieldValue(14,ItemValue1); //Field number 14 = Duration, value in minutes
if ItemValue1 <> '' then LogMessage(' Get result lenght011:'+ItemValue1+'||');
//LogMessage(' Get result lenght012:'+HTMLValues(HTML,'<span class="ipc-metadata-list-item__label">Runtime</span>','</ul>','<li role="presentation" class="ipc-inline-list__item">','</li>',', ',endPos)+'||');
ItemValue00:=TextBetWeen(HTML,'<div class="ipc-metadata-list-item__content-container">','hour</div></li>',false,curPos); //Strings which opens/closes the data. WEB_SPECIFIC
LogMessage(' Get result Original Runtime111:'+ItemValue00+'||');
if ItemValue00 <> '' then
AddFieldValueXML('length',IntToStr(3600*StrToInt(ItemValue00))); //~length~ Value in seconds.
if ItemValue00 <> '' then AddCustomFieldValueByName('Run time1',IntToStr(60*StrToInt(ItemValue00)));
if ItemValue00 <> '' then LogMessage(' Get result Original Runtime111:'+ItemValue00+'||');
if ItemValue00 <> '' then LogMessage(' Get result lenght0111:'+ItemValue00+'||');
End;
But, I can live without that and I am immensely grateful to you
-
Welcome.
When I have the option of free time, I'll check why this does not work properly.
-
Hello Ivek! I hope things are better this December for you and your mother. Just wanted to ask if any IMDb script is usable at the moment? Thanks.
-
Hello Ivek! I hope things are better this December for you and your mother. Just wanted to ask if any IMDb script is usable at the moment? Thanks.
Thank you for your wishes, especially now in the month of December.
The IMDB_[EN][HTTPS]_TEST_1 script and maybe another one work, but it doesn't transfer all the information, especially from the basic movies IMDB pages.
-
The IMDB_[EN][HTTPS] script no longer downloads certain information for movies because there have been major changes in the source code of certain web pages. The script only downloads information from the basic Movies page. It currently also downloads information from the Full Cast & Crew, Awards and Plot Keywords web pages. Here, too, there will be changes in the source code sometime by the end of February. Currently, it still downloads movies information from the Reference View website for movies, but it's only a matter of time how long this will be, because the Reference View website is supposed to be discontinued in the near future, unfortunately for us of course.
There will be many problems for corrections in the IMDB_[EN][HTTPS] script, it is also possible that certain web pages and the transfer of information will no longer be possible in the future.
Even from the pages listed above [EN][HTTPS] the script practically does not transfer any information anymore, except only downloads information from the basic Movies page. So there won't be any new IMDB_[EN][HTTPS] script updates anymore because it is no longer possible to download many full downloads of information. The new Imdb website design does not allow this anymore.
-
Hello Ivek. Since IMDB_Series-year custom field import doesn't work for me anymore, how can I disable overwriting older records of this fields from the times it worked.
Now, while earlier it was imported for example as TV Series (1999–2013) when I import now for that record, it gets overwritten with TV Series ().
How to avoid this, how to disable importing this field in order to preserve at least older records.
-
Find this record in the script and block it easily as you will see below.
//AddCustomFieldValueByName('IMDB_Series-year',yearValue);
In the same way, you can block almost any field (maybe not some field, because for some reason or function it is not possible).
-
Thank you, Ivek.
Is there any field that now outdated IMDb series and episodes scripts import that IMDB_[EN][HTTPS]_TEST_2b.psf does not, when updating existing record only, not when importing series for the first time?
Or, to rephrase it: which fields don't work anymore in outdated IMDb series and episodes scripts?
-
Wait a few days, I will try to prepare test scripts for series and episodes. Then it will be seen what can be transferred.
-
Of course, thank you so much!
-
You can find the corrected IMDB_[EN][HTTPS](series)_TEST_2b script at the link below.
http://www.videodb.info/forum_en/index.php/topic,4134.msg22017.html#msg22017
-
Thank you Ivek. Obviously, something is wrong with my PVD config. The only thing I get now comparing to outdated series script is the Series year. No seasons/episodes, no plot no Synopsis...
It looks like even this doesn't work anymore:
if Pos('TV Series',ItemValue)>0 then yearsValue1:=yearsValue1+'TV Series ';
if yearsValue1 <> '' then LogMessage(' Get result yearsValue1:'+yearsValue1);
So instead of, for example TV Series (2018-2023), now I'm getting just 2018-2023
-
Thank you Ivek. Obviously, something is wrong with my PVD config. The only thing I get now comparing to outdated series script is the Series year. No seasons/episodes, no plot no Synopsis...
It looks like even this doesn't work anymore:
if Pos('TV Series',ItemValue)>0 then yearsValue1:=yearsValue1+'TV Series ';
if yearsValue1 <> '' then LogMessage(' Get result yearsValue1:'+yearsValue1);
So instead of, for example TV Series (2018-2023), now I'm getting just 2018-2023
Probably not, because maybe I missed something in the update, like for example to download Synopsis data. I haven't been able to make an update for seasons/episodes yet, because it will be more problematic to make a correction.
I'll check for Series year, but you'll probably need to change the name of the custom field.
-
Thank you!
-
Synopsis data download fixed.
Series year is now fixed to pass data to the IMDB_Series-year custom field and no need to change the name of the custom field.
You can find the corrected script at the link below.
http://www.videodb.info/forum_en/index.php/topic,4134.msg22017.html#msg22017
-
Hello and thank you a ton Ivek.
Here's the update: Imdb_Series-Year now works, plot is imported, but number of episodes and seasons, as well as custom field synopsis don't work.
Interestingly, Imdb_Movies_2b imports synopsis.
-
as well as custom field synopsis don't work.
Interestingly, Imdb_Movies_2b imports synopsis.
Synopsis works for me.
Here's the update: Imdb_Series-Year now works, plot is imported, but number of episodes and seasons, as well as custom field synopsis don't work.
Interestingly, Imdb_Movies_2b imports synopsis.
I haven't been able to make an update for seasons/episodes yet, because it will be more problematic to make a correction.
-
Notification:
Maybe some people have too big wishes, which cannot be realized so easily. The new look of the IMDb website has become very problematic, because now the source code of the page is written in such a way that certain parts of the source code are simply not possible or can no longer be correctly added to the scripts in order for them to transfer the correct data or for certain information to be transferred at all .
Something like this is happening now when arranging the number of episodes and seasons.
One of the examples is now the search for results, where it was necessary to create a new script for searching for results, because the existing scripts for movies, series or episodes do not allow the possibility to add code for searching for results, or it does not work due to the very design or form of the created script .
If there are solutions, the information will be transferred, otherwise this information will no longer be in the database, because it simply cannot be added to scripts.
-
Dear Ivek,
I admit I have big wishes, but with most positive motives for PVD, not to be selfish. I apologize if I sounded ungrateful. I hope after 14 years I am not recognized as such, but will do anything to assure anyone I am not.
Most honestly, any update I consider a miracle, nothing less!
Meaning - you are a Miracle-man, and I mean it, and I know who ever still use PVD think the same. Whenever you stop, you already gave us a dozens of times more than what was real, and expected and as for me, I will never forget what you did for us.
Best regards
-
Thank you.
I just wanted to say that sometimes it is very difficult to find the right solution for a certain problem.
-
Synopsis data download fixed.
Synopsis data download fixed, so that it now also transfers information to the comment field and to the custom IMDB Synopsis memo field. The Summaries information is now transferred to the comment field. Summaries information is mostly present on web pages. A custom IMDB-Synopsis memo field has also been added, because in some cases Synopsis information is also present on web pages.
You can find the corrected script at the link below.
http://www.videodb.info/forum_en/index.php/topic,4134.msg22017.html#msg22017
-
Please attach a picture for " Number of Episodes/Seasons: " where you still have the old visible information in the Seasons-Episodes custom field so that I can easily arrange the transfer of the information to the Seasons-Episodes custom field.