Author Topic: Allmovie.com https  (Read 34242 times)

0 Members and 1 Guest are viewing this topic.

Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2667
    • View Profile
Re: Allmovie.com https
« Reply #60 on: December 12, 2021, 03:31:00 pm »
Here is the AllMovie.com HTTPS (Simple) script, which is used to search for results and download url links to AllMovie web pages and to saved AllMovie web pages on Wayback Machine Archive servers, as many of them are stored there in their archives.

List of custom fields that are in the script.


Quote
AllMovie data:         PVD field:      FN:      Type/Comments:
--------------         ---------      --      -------------
Amazon            ~Amazon~               memo (link to Search on Amazon)
Awards            ~AllMovie Awards~         memo (link to AllMovie Awards tab)
Related            ~AllMovie Related~      memo (link to AllMovie Related tab)
Releases            ~Feature~            memo (link to AllMovie Releases tab)
            AND   ~AllMovie DVD Releases~   memo (link to AllMovie Releases tab)
Title            ~mfTitle~         1      standard short text
            OR   ~Title~         2      short text or long text
            AND   ~Origtitle~         2      long text
Updated            ~Updated~               long text
            OR   ~UpdatedA~               long text   
            OR   ~Update~               short text            
URL               ~mfURL~         1      standard memo
            OR   ~URL~         2      memo
            OR   ~AllMovie.com~         memo      
            AND   ~AMG Wayback Machine Archive0~         memo      
            AND   ~AMG Wayback Machine Archive1~         memo
            AND   ~AMG Wayback Machine Archive2~         memo            
Search Movie results   ~Search Movie results~   memo (link to Search on AllMovie)
AllMovie.com tabs URL      ~AllMovie.com URL~(~ARL~)    memo     (link to AllMovie Cast&Crew tab OR
                                        link to AllMovie Review tab OR
                                        link to AllMovie Awards tab OR
                                        link to AllMovie Releases tab OR
                                        link to AllMovie Related tab OR
                                        link to AllMovie Search Movie results OR
                                        link to Search on Amazon)

Here is also a list of custom fields that are added with the check box option.

Quote
//Custom field names to use
//   IMPORTANCE_FIELD      = 'High Historical Importance';
//   ARTQUALITY_FIELD      = 'High Artistic Quality';
//   ARTLOWQUALITY_FIELD   = 'Low Artistic Quality';
//   LOWPRODUCTION_FIELD   = 'Low Production Values';
//   LOWBUDGET_FIELD      = 'Low Budget';
//   HIGHBUDGET_FIELD      = 'High Budget';
//   HIGHPRODUCTION_FIELD   = 'High Production Values';
   CULT_FIELD         = 'Cult Film';
//   SLEEPER_FIELD      = 'Sleeper';   
   AWARDS_FIELD         = 'All Awards tab';
   RELEASES_FIELD       = 'DVD Releases';
   RELATED_FIELD      = 'Related tab';
   HTTPRELATED_FIELD      = 'Related HTTP/503';
   NORELATED_FIELD      = 'No Related Movies';

AllMovie.com HTTPS (Simple) script  is attached.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2667
    • View Profile
Re: Allmovie.com https
« Reply #61 on: December 14, 2021, 08:50:02 am »
Here is the AllMovie.com HTTPS(DVDReleases) script, which downloads dvd information and also to saved AllMovie DVD web pages on Wayback Machine Archive servers, as many of them are stored there in their archives.

List of custom fields that are in the script.


Quote
AllMovie data:         PVD field:      FN:      Type/Comments:
--------------         ---------      --      -------------
Category.DVD         ~Category.DVD~            multiselect list
Category - DVD      ~Category - DVD~            multiselect list
Category-DVD1      ~Category-DVD1~            multiselect list   
Category-DVD2      ~Category-DVD2~            multiselect list
Allmovie DVD1      ~Allmovie DVD1~            memo
Allmovie DVDweb      ~Allmovie DVDweb~            memo
Allmovie DVDweb1      ~Allmovie DVDweb1~         memo
URL           ~AMG Wayback Machine Archive3~      memo   

AllMovie.com HTTPS(DVDReleases) script  is attached.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2667
    • View Profile
Re: Allmovie.com https
« Reply #62 on: December 14, 2021, 08:54:39 am »
Here is the AllMovie.com HTTPS(Related) script, which downloads related url links and information to AllMovie Related web pages.

List of custom fields that are in the script.


Quote
AllMovie data:         PVD field:      FN:      Type/Comments:
--------------         ---------      --      -------------
RelatedMovies      ~RelatedMovies~            memo
Related Movies      ~Related Movies~            memo

AllMovie.com HTTPS(Related) script  is attached.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2667
    • View Profile
Re: Allmovie.com https
« Reply #63 on: December 14, 2021, 08:58:23 am »
Here is the AllMovie.com HTTPS(Awards) script, which transfers the list of awards information to AllMovie Awards web pages.

List of custom fields that are in the script.


Quote
AwardsList           ~AwardsList~            memo
AwardsList1           ~AwardsList1~            memo

AllMovie.com HTTPS(Awards) script  is attached.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline afrocuban

  • Moderator
  • *****
  • Posts: 444
    • View Profile
Re: Allmovie.com https
« Reply #64 on: February 09, 2022, 03:07:28 am »
Thank you Ivek for a lot of work! Can you please explain if some of these script is cumulative, or we have to have them all and run them all separately in order to get maximu data? Thank youin advance.

Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2667
    • View Profile
Re: Allmovie.com https
« Reply #65 on: February 10, 2022, 09:08:22 am »
Thank you Ivek for a lot of work! Can you please explain if some of these script is cumulative, or we have to have them all and run them all separately in order to get maximu data? Thank youin advance.

AllMovie.com_new_HTTPS script and AllMovie.com_new_HTTPS_a script are for normal use. The AllMovie.com HTTPS (Simple) script is also for this purpose or to obtain a url address when searching for results.

AllMovie.com HTTPS (DVDReleases) script, AllMovie.com HTTPS (Related) script and AllMovie.com HTTPS (Awards) script are secondary scripts that you can use according to your wishes if you want to have any of this information in the PVD database.

You can use them alone or make a batch file in which you enter certain names of scripts with which you want to transfer certain information. You run the batch file once for all scripts, so you don't have to run each script individually.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline afrocuban

  • Moderator
  • *****
  • Posts: 444
    • View Profile
Re: Allmovie.com https
« Reply #66 on: February 10, 2022, 02:57:29 pm »
Thank you for clear explanation!

Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2667
    • View Profile
Re: Allmovie.com https
« Reply #67 on: February 10, 2022, 06:18:16 pm »
Thank you for clear explanation!

Welcome.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2667
    • View Profile
Re: Allmovie.com https
« Reply #68 on: November 22, 2023, 02:04:27 pm »
In a few days, a new AllMovie.com HTTPS script version will be uploaded, which will work in PVD MOD versions of the program without the Proxomitron program. It is currently being tested for possible bugs.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2667
    • View Profile
Re: Allmovie.com https
« Reply #69 on: November 27, 2023, 06:36:33 pm »
Here is the new AllMovie.com HTTPS script beta for PVD MOD versions. It works the same way as IMDB_[EN][HTTPS] script for PVD MOD versions.

If you have such a url http://www.allmovie.com/movie/10-things-i-hate-about-you-v177526 downloads data from AllMovie Overview page only and adds such
http://www.allmovie.com/movie/10-things-i-hate-about-you-vm1127949 new url address. In the case of novice addresses in the database, a new url address is added and all the data that is there and can be transferred by the script is transferred, if it is also primarily enabled there.

Here are some settings you can change manually.
Quote
  GET_ACTORS   = True;   //Set to False to ensure ~ctActors~ not added even if 'Overwrite fields' setting allows
  GET_DURATION   = True;   //Set to False to ensure ~mfDuration~ not set even if 'Overwrite fields' setting allows
  //Note the program will overwrite this with the actual media duration in any case   
  GET_POSTER   = True;   //Set to False if posters not wanted (or to handle bad image URL causing HTTP 404 error)   
  //GET_POSTER   = False; //Set to False if posters not wanted (or to handle bad image URL causing HTTP 404 error)
  GET_RATING   = True;   //Set to False to ensure ~mfRating~ not set even if 'Overwrite setting' fields setting allows 
  GET_THEMES      = True;   //Set to False to ensure ~mfCategory~ not added even if 'Overwrite fields' setting allows   
//  GET_FEATURES  = True ; //Download Url Releases provider page for retreive the Releases info
  GET_FEATURES  = False ; //Download Url Releases provider page for retreive the Releases info
  GET_URLID      = True;    //Set to True or False if URLID added or not added in Allmovie DVD custom fields   
  DEBUG        = True; 
  GET_FULL_REVIEW  = True ;  //Download Review provider page for retreive the Summaries info. Otherwise only the info of the principal movie page 
  //GET_FULL_REVIEW  = False ;  //Download Review provider page for retreive the Summaries info. Otherwise only the info of the principal movie page   
  PEOPLE_LIMIT  = 15;    //Limit of number of actors (cast) or of credits (crew) retrieved 
  GET_FULL_CREDIT  = True ;  //Download Cast or Credit provider page for retreive the info. Otherwise only the info of the principal movie page.
//  GET_FULL_AWARDS  = True ;  //Download Awards provider page for retreive the info. Otherwise doesn't do nothingh because no info in the principal movie page.
  GET_FULL_AWARDS  = False ;  //Download Awards provider page for retreive the info. Otherwise doesn't do nothingh because no info in the principal movie page.
//  GET_FULL_RELEASED  = True ;  //Download Releases provider page for retreive the Releases info.
  GET_FULL_RELEASED  = False ;  //Download Releases provider page for retreive the Releases info.
//  GET_FULL_RELATED  = True ;  //Download Related provider page for retreive the Connection (Related)  info. Otherwise no info of the Connections provider page.
  GET_FULL_RELATED  = False ;  //Download Related provider page for retreive the Connection (Related)  info. Otherwise no info of the Connections provider page.
  CONNECT_LIMIT  = 12; 
//  GET_CONNECT      = True ;    //Set to False if Connection (Related) movies not added (wanted) even if 'Overwrite fields' setting allows   
  GET_CONNECT      = False ;    //Set to False if Connection (Related) movies not added (wanted) even if 'Overwrite fields' setting allows   
  GET_CONNECT_FULL   = True ;  //Download Related provider page for retreive the Connection (Related) wanted to Download full Related info.
//  GET_CONNECT_FULL   = False ;  //Download Related provider page for retreive the Connection (Related) not wanted to Download full Related info.
 
//  GET_FULL_CONNECT   = True ;    //Set to False if Connection (Related) movies not added (wanted) even if 'Overwrite fields' setting allows   
  GET_FULL_CONNECT   = False;    //Set to False if Connection (Related) movies not added (wanted) even if 'Overwrite fields' setting allows
  GET_FULL__CONNECT   = True ;    //Set to False if Connection (Related) movies not added (wanted) even if 'Overwrite fields' setting allows 
//  GET_FULL__CONNECT   = False;    //Set to False if Connection (Related) movies not added (wanted) even if 'Overwrite fields' setting allows 

Here is also a list of normal fields and custom fields that you can add to the database.
Quote
FIELD USE:

Field names in comments are enclosed in "~" so they are easier to find in the script.
Use with your editor's search function to find applicable code sections.

AllMovie data:         PVD field:      FN:      Type/Comments:
--------------         ---------      --      -------------
Actors            ~ctActors~      1, 3      credits (if GET_ACTORS true)
Alternate title      ~mfAka~               memo
            OR   ~Alternate title~         memo
AllMovie rating         ~mfRating~      1, 3      'Additional rating' named 'AllMovie.new' (if GET_RATING true)
            OR   ~AllMovie rating~      2      rating
//Amazon            ~Amazon~               memo (link to Search on Amazon)
AMG ID            ~AMG ID~               short text
            AND   ~AMG ID1~            long text
            AND   
AMG "movie_id" ID      ~AMG Wayback Machine Archive~    memo (link to Search on Wayback Archive)
            OR   ~AMG Wayback Machine Archive1~    memo (link to Search on Wayback Archive)
//Awards            ~AllMovie Awards~            memo (link to AllMovie Awards tab)
Cast               ~Cast~               memo
Crew               ~Crew~               memo
Category            ~Category.AllMovie~         multiselect list
                                 —not to be confused with ~mfCategory~ (used for 'Themes')
Characteristics      
               ~Moods~         2      multiselect list (from 'Characteristics')
            AND   ~Mood links~            memo (hyperlinks to AllMovie mood pages  —if available in web archive
            AND   ~Mood-links web archive~      memo (hyperlinks to AllMovie mood pages  —if available in web archive
            OR   ~Mood-links web archive1~      memo (hyperlinks to AllMovie mood pages  —if available in web archive
            AND   ~Mood-webarchive~      memo (hyperlinks to AllMovie mood pages  —if available in web archive            
            OR   ~Mood-webarchive2~      memo (hyperlinks to AllMovie mood pages  —if available in web archive   
               ~mfTags~               standard memo
               ~Keywords~      2      memo (from 'Characteristics')
               ~Attributes~      2      multiselect list (from 'Characteristics')
Themes from 'Characteristics'
               ~mfCategory~      1      standard multiselect list (if GET_THEMES true) (from 'Characteristics')
            OR   ~Themes~         2      multiselect list (from 'Characteristics')
            AND ~Themes links~      2      memo (hyperlinks to AllMovie themes pages)
Country            ~mfCountry~      1      standard multiselect list
            OR   ~Country~         2      multiselect list
Cover-art            ~Poster~         1, 3      standard (if GET_POSTER true)
Directed by         ~ctDirectors~      1      standard multiselect list
Flags            ~Flags~               multiselect list
Genres            ~mfGenre~         1      standard multiselect list
            OR   ~Genres~         2      multiselect list
            OR   ~AGenres~      2          multiselect list            
            AND   ~Genre links~            memo (links to AllMovie Genre page)
MPAA rating         ~MPAA rating~            short text, multiselect list
            OR   ~AllMovie_Rating~            short text
Produced by         ~mfStudio~      1      standard short text
            OR   ~Produced by~      2      multiselect list
//Related            ~AllMovie Related~         memo (link to AllMovie Related tab)
Review            ~Review~               memo
Release date          ~ rdate ~      1      standard short text
               ~Released~            short text (multiple dates)
            OR   ~Release date~           long text (multiple dates)               
            OR   ~AllMovieReleaseDate~      short text
               ~AllMovie ReleaseYear~      short text
//OR   Released         ~Released~            short text (more common single date)
Releases            ~mfFeatures~      1      standard memo (link to AllMovie Releases tab)
Released by          ~Released by~             short text

Run time            ~mfDuration~      1, 3      standard number (if GET_DURATION true)
            OR   ~Run time~      2      number (minutes)
Synopsis            ~mfDescription~         standard memo
                                 —use PVD preference to save in ANY available memo field
            OR   ~Synopsis~            memo
Sub-Genres         ~Sub-Genres~            multiselect list
            OR   ~Sub-Genre links~         memo (links to AllMovie page)
Title            ~mfTitle~         1      standard short text
            OR   ~Title~         2      (short text) memo
            OR   ~Title1~         2      memo            
Year               ~mfYear~         1      standard number (from AllMovie 'Title (Year)' heading)
            OR   ~Year~         2      short string   
            OR   ~Years~         2      short text            
Updated            ~Updated~               long text
            OR   ~AllUpdated~               long text
URL               ~mfURL~         1      standard memo
            OR   ~URL~         2      memo
            OR   ~AllMovie.com~         memo   
            OR   ~AllMovieURL~         memo   
            OR   ~AllMovie URL~         memo               
            
AllMovie.com tabs URL      ~AllMovie.com URL~    memo     (link to AllMovie Cast&Crew tab OR link to AllMovie Review tab OR link to AllMovie Awards tab OR link to AllMovie Releases tab OR link to AllMovie Related tab OR link to AllMovie Search Movie results OR link to Search on Amazon)   

New fields

AMovietype         ~AMovietype~            multiselect list      
OrigTitle         ~mfOrigTitle~         1      standard long text
            OR   ~OrigTitle~         2      long text
AllMovies         ~AllMovies~            check box            
All Awards tab      ~All Awards tab~         check box
            AND   ~AwardsList~         memo
            OR   ~AwardsList1~         memo
DVD Releases         ~DVD Releases~         check box
            AND   ~Allmovie DVD1~         memo
Related tab         ~Related tab~         check box
Distributed By      ~Distributed By~         short text
Related Movies(Overview)      ~AddConnection~
               ~Related Movies         memo (Related Movies list to AllMovie Overview tab)
            AND   
Related Movies(Related tab)
               ~RelatedMovies~         multiselect list (Related Movies Category list to AllMovie Related tab)          
            OR   ~Related-Movies~           memo    (full list) (Related Movies list to AllMovie Related tab)                
            
~MID ID:~ and ~NUM ID:~
               ~MID ID:~            number (Movie MID ID)   
               ~NUM ID:~            number (Movie NUM ID)   

There are also links to pages on which similar lists have already been described.

http://www.videodb.info/forum_en/index.php/topic,4109.msg21362.html#msg21362

http://www.videodb.info/forum_en/index.php/topic,4109.msg21591.html#msg21591

http://www.videodb.info/forum_en/index.php/topic,4109.msg21593.html#msg21593

http://www.videodb.info/forum_en/index.php/topic,4109.msg21596.html#msg21596

http://www.videodb.info/forum_en/index.php/topic,4109.msg21598.html#msg21598

http://www.videodb.info/forum_en/index.php/topic,4109.msg21599.html#msg21599

http://www.videodb.info/forum_en/index.php/topic,4109.msg21600.html#msg21600


AllMovie.com[EN][HTTPS]_ b is attached.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline afrocuban

  • Moderator
  • *****
  • Posts: 444
    • View Profile
Re: Allmovie.com https
« Reply #70 on: December 03, 2023, 12:52:10 am »
Here is the new AllMovie.com HTTPS script beta for PVD MOD versions. It works the same way as IMDB_[EN][HTTPS] script for PVD MOD versions.


I can confirm that it works as intended and without Proxo. Thank you so much.

I must say though that I miss how fast previous script was since now the new one is significantly slower, especially considering pop up windows stealing focus now with this script as well as IMDb script does. I just used all scripts via Proxo as a .batch plugin (AM, FA & IMDb).


I'll probably try to experiment with Synopsis piece of code trying to implement it into old one if it's even possible...
« Last Edit: December 03, 2023, 12:54:31 am by afrocuban »

Offline Ivek23

  • Global Moderator
  • *****
  • Posts: 2667
    • View Profile
Re: Allmovie.com https
« Reply #71 on: December 03, 2023, 09:55:49 am »
Yes, this is a well-known issue and a problem with scripts (which cannot be fixed) that are made for PVD MOD versions of the programs. Here it takes longer because the curl program downloads each web page individually in its entirety (for example, first the search results, then the basic pages of a particular movie, then the pages with actors and so on). The more pages there are, the longer it takes to download all the information. For the AllMovie websites, it might be possible to make a special script for the Actors or Review pages, in which case the information transfer would be a little faster.
Ivek23
Win 10 64bit (32bit)   PVD v0.9.9.21, PVD v1.0.2.7, PVD v1.0.2.7 + MOD


Offline afrocuban

  • Moderator
  • *****
  • Posts: 444
    • View Profile
Re: Allmovie.com https
« Reply #72 on: December 03, 2023, 04:13:54 pm »
Yes, this is a well-known issue and a problem with scripts (which cannot be fixed) that are made for PVD MOD versions of the programs. Here it takes longer because the curl program downloads each web page individually in its entirety (for example, first the search results, then the basic pages of a particular movie, then the pages with actors and so on). The more pages there are, the longer it takes to download all the information. For the AllMovie websites, it might be possible to make a special script for the Actors or Review pages, in which case the information transfer would be a little faster.


Thank you immensely for your time Ivek. If I'm asked, I think it's not worthy to invest time in making the script what, 2 secs faster?

We are grateful for whatever makes PVD working one way or another. As I said. I will use PVD even when no script would work.