Personal Video Database

English => Support => Topic started by: afrocuban on October 10, 2017, 11:09:08 pm

Title: Allmovie.com https
Post by: afrocuban on October 10, 2017, 11:09:08 pm
One more https transition. Allmovie.com script isn't possible to use anymore in PVD?

Kind regards.
Title: Re: Allmovie.com https
Post by: UtNut on October 11, 2017, 08:50:10 pm

Same here, is there chance to work around https? Really love their comments.
Title: Re: Allmovie.com https
Post by: Ivek23 on October 12, 2017, 01:28:37 pm
Tests Proxomitron (http://www.videodb.info/forum_en/index.php/topic,4083.msg19992.html#msg19992). I think this would be an ideal solution for your problems. I also attach a default.cfg file that already has an added solution for the Allmovie.com https connection. How and what is described in topic:
Proxomitron - next https solution for PVD. (http://www.videodb.info/forum_en/index.php/topic,4083.msg19992.html#msg19992)

I did not test if it works, because at present I have many family responsibilities (my father is seriously ill) and there is no time for testing.

BTW:
I will know more about this somewhere around the first of November, how and what will happen in the next few months to the end of March of the following year.


default.cfg file is attach.
Title: Re: Allmovie.com https
Post by: afrocuban on October 14, 2017, 02:15:59 am
Dear Ivek,

So sorry to hear about your father. Wish him well, please!

Thank you for your kind answer. Following your proxomitron guide I actually made it work for allmovie.com! The only strange thing is that it doesn't import AllMovie synopsis anymore.

Kind regards



Title: Re: Allmovie.com https
Post by: Ivek23 on October 14, 2017, 08:23:44 am
Dear Ivek,

So sorry to hear about your father. Wish him well, please!

Thanks.

Thank you for your kind answer. Following your proxomitron guide I actually made it work for allmovie.com! The only strange thing is that it doesn't import AllMovie synopsis anymore.

Allmovie.com script requires mass updates, which I can not do with the current situation. But I hope that as soon as possible,
so stay tuned for messages.

At the moment and quickly, I made corrections only in the ParseSearchResults procedure so that the script finds search results for a specific movie.

Code: [Select]
procedure ParseSearchResults(HTML : String);
var
curPos, endPos : Integer;
Title, Year, URL, director : String;
begin
//List of other site number where search page :
TabNumber := [''];

// curPos := Pos('<option value="movies" selected>', HTML);
// curPos := Pos('div class="results-section movies">', HTML);
curPos := Pos('<li class="movie">', HTML);
if curPos < 1 then
Exit;

LogMessage('Parsing search results...');

//curPos := PosFrom('<a href="http://www.allmovie.com/movie/', HTML, curPos);
curPos := PosFrom('<a href="https://www.allmovie.com/movie/', HTML, curPos);
while curPos > 0 do begin
endPos := PosFrom('">', HTML, curPos);
URL := Copy(HTML, curPos + 9, endPos - curPos - 9);
    URL     := StringReplace(URL, 'https://', 'http://', True, True, False);

curPos := PosFrom('">', HTML, curPos)+2;
endPos := PosFrom('</a>', HTML, curPos);
Title := Copy(HTML, curPos, endPos - curPos);

curPos := PosFrom('</a>', HTML, curPos)+4;
endPos := PosFrom('</div>', HTML, curPos);
Year := RemoveTags(Trim(Copy(HTML, curPos, endPos - curPos)), false);

// curPos := PosFrom('">', HTML, curPos)+2;
// endPos := PosFrom('</a></dd>', HTML, curPos);
// director := RemoveTags(Trim(Copy(HTML, curPos, endPos - curPos)), false);

AddSearchResult(Title+' '+Year, '', '', URL, '');
curPos := PosFrom('<a href="https://www.allmovie.com/movie/', HTML, curPos);

end;

AddSearchResult('', '', '', '', '');

//Get Name of movie to search :               
    MovieName := GetFieldValue(2);
    Explodestring(MovieName,TabMovieName,#32);
    MovieName := '';
    For I:=low(TabMovieName) to High(TabMovieName) do
    Begin
    MovieName := MovieName + #43 + TabMovieName[I];
MovieName := StringReplace(MovieName, '/', '-', true, false, true);
    end;
//Add Links to Page with other sites in TabNumber:
    For I := Low(TabNumber) to High(TabNumber) do
    Begin
URL := 'http://www.allmovie.com/search/movies/'+MovieName;
//AddSearchResult('Search in '+MovieName+' on AllMovie.com','Movie results','',URL,'');
AddSearchResult('Search in '+MovieName+' on AllMovie.com','','',URL,'');
  end;
 
end;
Title: Re: Allmovie.com https
Post by: Ivek23 on October 15, 2017, 08:45:43 am
AllMovie.com_new_HTTPS script
version 1.1.2.5

I managed to fix the AllMovie.com_new script, which now has a new name and is now called the AllMovie.com_new_HTTPS script.

There may be some other errors, but maybe they might be corrected later.

AllMovie.com_new_HTTPS script  is attached.




For all guests:

You can find a link to download the script in AllMovie.com_new_HTTPS Movie Links topic. (http://www.videodb.info/forum_en/index.php/topic,4110.msg20182.html#msg20182)
Title: Re: Allmovie.com https
Post by: afrocuban on October 17, 2017, 01:50:21 am
Thank you, Ivek. The script works for me, but only with Proxomitron. Thank you.

Kind regards,
Title: Re: Allmovie.com https
Post by: VVV_Easy_Programing on October 17, 2017, 06:17:01 pm
Best wishes for your father, Ivek.
Title: Re: Allmovie.com https
Post by: Ivek23 on October 17, 2017, 06:31:58 pm
Thank you, Ivek. The script works for me, but only with Proxomitron. Thank you.

Kind regards,

I am pleased. This was the only possible and quick solution to my current situation, which I could do for you all.
Title: Re: Allmovie.com https
Post by: Ivek23 on October 17, 2017, 06:38:13 pm
Best wishes for your father, Ivek.

Thanks. Fortunately, his situation is getting better.
Title: Re: Allmovie.com https
Post by: Ivek23 on October 22, 2017, 12:40:33 pm
AllMovie.com_new_HTTPS script
version 1.1.2.6

Repair some errors. So far it was possible to download information only for actors and director. From now on, there is also the possibility of downloading information for the writer, producer and composer.

New version of AllMovie.com_new_HTTPS script  is attached.




For all guests:

You can find a link to download the script in AllMovie.com_new_HTTPS Movie Links topic. (http://www.videodb.info/forum_en/index.php/topic,4110.msg20182.html#msg20182)
Title: Re: Allmovie.com https
Post by: UtNut on November 30, 2017, 07:39:37 pm
I'm always amazed how you're able to work around these things Ivek, even HTTPS doesn't stop you!
A clever constructed combination with Proxomitron allows this noob to gather information wanted from, in my case, Allmovie.com. I'm thanking you wholeheartedly for the many contributions you made and for keeping PVD alive, making it still the best movie database there is. I'm slowly approaching 5,000 records and I haven't found anything like it. I will also wish you all the best fixing your eyesight problems, if it would be helpful to you, my father in law of 86 years old just had his cataracts operations and now is able to see clearly and sharply without his glasses he was wearing for more than 66 years.
Many thanks again.

UtNut
Title: Re: Allmovie.com https
Post by: Ivek23 on December 02, 2017, 07:54:31 pm
I'm always amazed how you're able to work around these things Ivek, even HTTPS doesn't stop you!
A clever constructed combination with Proxomitron allows this noob to gather information wanted from, in my case, Allmovie.com. I'm thanking you wholeheartedly for the many contributions you made and for keeping PVD alive, making it still the best movie database there is. I'm slowly approaching 5,000 records and I haven't found anything like it. I will also wish you all the best fixing your eyesight problems, if it would be helpful to you, my father in law of 86 years old just had his cataracts operations and now is able to see clearly and sharply without his glasses he was wearing for more than 66 years.
Many thanks again.

UtNut

Thanks a lot.
Title: Re: Allmovie.com https
Post by: Todd89 on February 28, 2018, 01:14:36 pm
Hello Ivek

Is Allmovie script still working? It's not working for me .
I Installed  Proxomitron as you said in (Proxomitron - next https solution for PVD) Topic and download (AllMovie.com_new_HTTPS script version 1.1.2.6) But still
not working and gives me this Error: IOHandler Value Is Not Valid.

Title: Re: Allmovie.com https
Post by: Ivek23 on February 28, 2018, 03:37:24 pm
Hello Ivek

Is Allmovie script still working? It's not working for me .
I Installed  Proxomitron as you said in (Proxomitron - next https solution for PVD) Topic and download (AllMovie.com_new_HTTPS script version 1.1.2.6) But still
not working and gives me this Error: IOHandler Value Is Not Valid.

The IOHandler Value Is Not Valid message means you probably did not run the Proxomitron program or you do not have the correct default.cfg file in the Proxomitron program folder. Check to see if it will work and let me know, then we'll see if the script needs to be fixed.

You can also find the default.cfg file in this link:
http://www.videodb.info/forum_en/index.php/topic,4115.msg20312.html#msg20312
Title: Re: Allmovie.com https
Post by: Ivek23 on December 24, 2019, 08:30:43 pm
AllMovie.com_new_HTTPS script
version 1.1.2.7

Repair for small errors with poster code.

New version of AllMovie.com_new_HTTPS script  is attached.
Title: Re: Allmovie.com https
Post by: Ivek23 on December 26, 2019, 01:10:51 pm
AllMovie.com_new_HTTPS script
version 1.1.2.8

Repair for small corrections in the code for ParseMovie procedure.

New version of AllMovie.com_new_HTTPS script  is attached.
Title: Re: Allmovie.com https
Post by: RazorHall on December 27, 2019, 04:02:55 pm
I've downloaded the file and put it in the scripts folder, but Allmovie still doesn't appear as an import option, or in the plugins section under Preferences.  Did I miss a step?
Title: Re: Allmovie.com https
Post by: Ivek23 on December 27, 2019, 09:19:17 pm
I've downloaded the file and put it in the scripts folder, but Allmovie still doesn't appear as an import option, or in the plugins section under Preferences.  Did I miss a step?

Run PVD with debug.bat, then open log.txt to see if the script has errors or if it is in the Script folder at first. You copied AllMovie.com HTTPS.psf to the right folder, or not, it is also possible that it cannot be viewed as previously mentioned.
Title: Re: Allmovie.com https
Post by: RazorHall on December 28, 2019, 12:42:56 am
Okay, here's what the log file said about the Allmovie script:

(12/27/2019 5:40:41 PM) Compiling script: AllMovie.com HTTPS.psf
(12/27/2019 5:40:41 PM) Could not compile script: AllMovie.com HTTPS.psf
[Error] (402:75): Unknown identifier 'AllMovie'
Title: Re: Allmovie.com https
Post by: Ivek23 on December 28, 2019, 09:26:50 am
AllMovie.com_new_HTTPS script
version 1.1.2.9


Okay, here's what the log file said about the Allmovie script:

(12/27/2019 5:40:41 PM) Compiling script: AllMovie.com HTTPS.psf
(12/27/2019 5:40:41 PM) Could not compile script: AllMovie.com HTTPS.psf
[Error] (402:75): Unknown identifier 'AllMovie'

Thanks for the reported error. My mistake, I overlooked it. I fixed it and AllMovie.com HTTPS.psf is working fine.

New version of AllMovie.com_new_HTTPS script  is attached.
Title: Re: Allmovie.com https
Post by: RazorHall on December 28, 2019, 06:25:43 pm
Allmovie now appears as an import option, but I get the following error when I run it:

Socket Error #11001
Host not found.
Title: Re: Allmovie.com https
Post by: Ivek23 on December 28, 2019, 07:01:01 pm
Allmovie now appears as an import option, but I get the following error when I run it:

Socket Error #11001
Host not found.

I need a log file and a movie title or a more detailed description of when and how this error occurs. Repeat the procedure as described in this link below. Then I'll see and know what's going on.

http://www.videodb.info/forum_en/index.php/topic,4109.msg21008.html#msg21008
Title: Re: Allmovie.com https
Post by: RazorHall on December 28, 2019, 07:43:31 pm
I've attached the log file.  I receive that error every time I run the Allmovie script.  I tried it on a few different titles and got the same result each time.
Title: Re: Allmovie.com https
Post by: Ivek23 on December 28, 2019, 09:39:10 pm
I've attached the log file.  I receive that error every time I run the Allmovie script.  I tried it on a few different titles and got the same result each time.

I can't figure out what's wrong because the script works fine for me. Try AllMovie.com_new_HTTPS script version 1.1.2.7, which you can find at this link below, to see if this version also reports the same error.

http://www.videodb.info/forum_en/index.php/topic,4109.msg20986.html#msg20986
Title: Re: Allmovie.com https
Post by: RazorHall on December 28, 2019, 10:09:37 pm
No change when using the other version of the file.   :(

I don't know if this helps at all, but if I try running the script with only a title, and no link in the URL field, I get this error:

IOHandler value is not valid.
Title: Re: Allmovie.com https
Post by: Ivek23 on December 29, 2019, 08:31:21 am
No change when using the other version of the file.   :(

I don't know if this helps at all, but if I try running the script with only a title, and no link in the URL field, I get this error:

IOHandler value is not valid.

This error occurs. because AllMovie uses an https link and PVD does not recognize the https link, only recognizes the http link. It is necessary to activate the Proxy server in the PVD settings under Internet Connections, where the following information is entered in the appendix below.
Quote
It will also act PVD, you must also PVD settings \ Internet connection, find the "Proxy" and confirm. In the "Server" field enter "localhost" Port settings to 80 . Only with this configuration will function properly PVD. PVD is used only proxy port 80.

For this to work, you also need a Proxomitron program. If you are not already using it, then you will find more at this link in the appendix below.
Tests Proxomitron (http://www.videodb.info/forum_en/index.php/topic,4083.msg19992.html#msg19992). I think this would be an ideal solution for your problems. I also attach a default.cfg file that already has an added solution for the Allmovie.com https connection. How and what is described in topic:
Proxomitron - next https solution for PVD. (http://www.videodb.info/forum_en/index.php/topic,4083.msg19992.html#msg19992)

The Proxomitron program I use on my own can be found more at this link below.
http://www.videodb.info/forum_en/index.php/topic,4125.msg20409.html#msg20409

I also attach the latest default.cfg file that already has an added solution for the Allmovie.com https connection.


default.cfg is attached.
Title: Re: Allmovie.com https
Post by: Ivek23 on December 29, 2019, 08:43:15 am
The Proxomitron program I use on my own can be found more at this link below.
http://www.videodb.info/forum_en/index.php/topic,4125.msg20409.html#msg20409.

Notice:
All 4 parts of the Proxomitron1 (and rar format) file need to be downloaded if you want to have all the files and Proxomitron will work properly.
Title: Re: Allmovie.com https
Post by: Ivek23 on December 29, 2019, 04:29:39 pm
AllMovie.com_new_HTTPS script
version 1.1.3.0

Some beauty fixes and improvements to the scripts code.

New version of AllMovie.com_new_HTTPS script  is attached.
Title: Re: Allmovie.com https
Post by: RazorHall on December 29, 2019, 06:44:37 pm
Changing the proxy settings and using Proxomitron has allowed the Allmovie script to work in most cases.  Thanks, Ivek!

I've only gotten one error so far, on one title, and that's Zombie Dearest (https://www.allmovie.com/movie/zombie-dearest-v570551).  The error is:

HTTP/1.1 400 Host Not Found
Title: Re: Allmovie.com https
Post by: Ivek23 on December 29, 2019, 08:14:41 pm
Changing the proxy settings and using Proxomitron has allowed the Allmovie script to work in most cases.  Thanks, Ivek!

Welcome. I'm glad the script is working and we have resolved the problem with the proxy settings.

I've only gotten one error so far, on one title, and that's Zombie Dearest (https://www.allmovie.com/movie/zombie-dearest-v570551).  The error is:

HTTP/1.1 400 Host Not Found

Thanks for the error. The culprit is the poster download code, which I also assumed was because I myself had a reported error when I tested the script. The error will probably be fixed tomorrow.
Title: Re: Allmovie.com https
Post by: RazorHall on December 29, 2019, 11:41:48 pm
Thanks for the error. The culprit is the poster download code, which I also assumed was because I myself had a reported error when I tested the script. The error will probably be fixed tomorrow.

That's awesome.  Thank you again for all your assistance and hard work! 
Title: Re: Allmovie.com https
Post by: Ivek23 on December 30, 2019, 06:31:49 pm
AllMovie.com_new_HTTPS script
version 1.1.3.1

Poster error corrected. It was repaired some more mistakes. However, a link to the Wayback Machine Archive has been added, where you can find an archived version of the AllMovie movie page if it has been archived.


Quote
AllMovie data:         PVD field:      FN:      Type/Comments:
--------------         ---------      --      -------------
.
.
.
AMG "movie_id" ID      ~AMG Wayback Machine Archive~    memo (link to Search on Wayback Archive)

.
.
.
// ~AMG "movie_id" ID~
 endPos:=curPos;
 endPos:=PosFrom('var gptAdSlots = [];',HTML,curPos);
 curPos:=PosFrom('googletag.pubads().setTargeting('+#39+'movie_id'+#39+', '+#39+'v',HTML,endPos)+Length('googletag.pubads().setTargeting('+#39+'movie_id'+#39+', '+#39+'v');
   endPos:=PosFrom(#39+');',HTML,curPos);
   TmpStr2:=Copy(HTML,curPos,endPos-curPos);
    //TmpStr2:=RemoveTags(Trim(Copy(HTML,curPos,endPos-curPos)),false);
 AddCustomFieldValueByName('AMG Wayback Machine Archive','<link url="http://web.archive.org/web/*/http://www.allmovie.com/work/'+TmpStr2+'">AllMovie Wayback Machine Archive</link>');
 if TmpStr2 <> '' then LogMessage('      Parse Results AMG ID1:'+TmpStr2);

New version of AllMovie.com_new_HTTPS script  is attached.
Title: Re: Allmovie.com https
Post by: afrocuban on January 09, 2020, 12:35:13 am
Thank you and Happy New Year, dear Ivek!