Personal Video Database
English => Development => Scripts and Templates => Topic started by: VVV_Easy_Programing on January 17, 2014, 06:29:06 pm
-
I attached my script to scrape the information of the web Spanish FilmAffinity. If you want to try use the name of movies in Spanish "La vida de Pi"="Life of Pi" (finds at first) or "Padrino"="Godfather" to search by list (the script no handles advanced search).
On the other hand I tried to make it as easy as possible to understand for subsequent public use. It also includes an example so that it can adapt. I copy the introduction of Script:
" This is a script designed to be easy to understand and to adapt. For this reason may be missing some fields and
the programming may not be smart. It's a only "One Pass" Script and get data in WEB SECUENTIAL ORDER.
The Personal Video Data field names in comments are enclosed in "~" so they are easier to find in the script.
The WEB_SPECIFIC comentary points out the specific text for Web fields.
Use with your editor's search function to find applicable code sections and adapt script."
(Edito: New version down)
-
v 0.1.1.0 VVV: Minor corrections and ameliorations
-
Script works fine, but does have some drawbacks, namely:
1. Instead of this //Get ~Duration~. (User option GET_DURATION)
if GET_DURATION then begin
PVDField:='duration';
.
.
.must be as follows
//Get ~Duration~. (User option GET_DURATION)
if GET_DURATION then begin
PVDField:='length';
.
.
.duration is incorrectly displayed
web page PVD field
91 min 0:01:31
152 min 0:02:33
proper duration is as follows
web page PVD field
91 min 1:31:00
152 min 2:32:00
2. Year in some movies do not pass, here are some links:
http://www.filmaffinity.com//es/film485513.html
http://www.filmaffinity.com//es/film642021.html
http://www.filmaffinity.com//es/film345561.html
http://www.filmaffinity.com//es/film557483.html
3. Genre in some movies is not transferred correctly, here are a few links:
http://www.filmaffinity.com//es/film560132.htmlDrama, Romance, Premios 1962, 1962, CrÍticas La maravillosa novela de Nabokov tuvo una excelent, Kubrick se atreve con la turbulenta relación de un padrastro y su hija adolescente, creando una película bella, sugerente y desgarradora sobre la perversa obsesión de la naturaleza humana. La polémica ya estaba servida de antemano, pero el arte acalló las voces religiosas que se levantaron contra su exhibición. Muy buena. Pablo Kurt: F, vigoroso y arriesgado ejercicio de puesta en pantalla que nos abre al Kubrick en plena posesión de su talento" , La maravillosa novela de Nabokov tuvo una excelente adaptación cinematográfica a cargo de otro maestro singular. Así, Pablo Kurt: FILMAFFINITY "Gran cine e inteligente, "Gran cine e inteligente, Ángel Fdez. Santos: Diario El País, Puedes hacer una crÍtica de esta pelÍcula para que el resto de los usuarios la pueda leer. AÑade tu crÍtica, AÑade tu crÍtica, Votaciones de almas gemelas RegÍstrate, RegÍstrate, PosiciÓn rankings listas 55 Mis adaptaciones de libros / novelas preferidas, 55 Mis adaptaciones de libros / novelas preferidas, Mis adaptaciones de libros / novelas preferidas, Las películas más eróticas que recuerdo, Mis películas británicas & irlandesas favoritas (NUEVA LISTA), Si alguna sinopsis cuenta demasiados detalles del argumento -o para corregir errores o completar datos de la ficha- por favor, mensaje, AÑade FA a tus webs favoritas, FA en Facebook
http://www.filmaffinity.com//es/film619271.html
Terror, http://www.theasylum.cc/product.php?id=229, Puedes hacer una crÍtica de esta pelÍcula para que el resto de los usuarios la pueda leer. AÑade tu crÍtica, AÑade tu crÍtica, Votaciones de almas gemelas RegÍstrate, RegÍstrate, Si alguna sinopsis cuenta demasiados detalles del argumento -o para corregir errores o completar datos de la ficha- por favor, mensaje, AÑade FA a tus webs favoritas, FA en Facebook
-
Thank you very much for your work. I think I've corrected the mistakes you point me:
v 0.1.2.0 VVV: Corrections: Duration (field name and length in seconds), genres (movies without category).
Improvements: RemoveTags (Simplify the Web delimitators choice)
(The year works fine now without knowing why)
Attached the new version
-
(The year works fine now without knowing why)
Hi, I think I found a solution for year movie, I tested a few movies and it works fine (see attached image).
Here is the solution:
procedure ParseMovie(HTML:String;MovieURL:AnsiString);
var
curPos,endPos:Integer;
PVDField,Years,WebFieldText,WebFieldOpen,WebFieldBegin,WebFieldEnd,WebItemBegin,WebItemEnd:String;
begin
LogMessage('procedure ParseMovie');
.
.
.
//Get ~year~
PVDField:='year'; //For easy programation
WebFieldText:=' Year:'; //Only for Debuging
WebFieldOpen:='<dt>Ańo</dt>'; //Web only one value. WEB_SPECIFIC
WebFieldBegin:='<dd>'; //WEB_SPECIFIC
WebFieldEnd:='</dd>'; //WEB_SPECIFIC
endPos:=endPos+Length(WebFieldOpen);
curPos:=PosFrom(WebFieldBegin,HTML,curPos)+Length(WebFieldBegin);
endPos:=PosFrom(WebFieldEnd,HTML,curPos);
Years:= Copy(HTML,curPos,endPos - curPos);
//curPos:=GetPVDFieldOneValue(HTML,curPos,PVDField,WebFieldText,WebFieldOpen,WebFieldBegin,WebFieldEnd);
AddFieldValueXML(PVDField,Years);
LogMessage(' Years:'+Years+'||'+PVDField);
//Get ~Lenght~. (User option GET_LENGTH)
.
.
.
-
Thank you very much another time. I think I've corrected the mistakes you point me (without spoiling it for other users)
v 0.1.3.0 VVV: Roundabout for the spanish letter of <dt>Año</dt>". Some user see as "<dt>Ańo</dt>".
(I do not know if the problem is given by the function HTMLToText that converts "<dt>Año</dt>" different depending on regional configuration. I made a roundabout replacing the text sent by Ivek23 but i cann't test it)
Attached the new version
-
Does not work, I add my modification of scripts, which normally displays year of the movie.
-
It works for you and me! Thank you very much.
v 0.1.4.0 VVV: Officialized Ivek23 modify for the year problem.
Attached the new version
-
Thanks, it's OK.
-
something happened that no longer works :-\
-
CHANGE LOG:
v 0.1.4.2 VVV: Adjust WEB_SPECIFIC to new API.
Attached the new versión
(Edito: New version down)
-
Thanks, script works fine.
-
Thanks, perfect work
-
Completely redone :) :D :). The structure of the script is linear.
CHANGE LOG (26/12/2014):
V 0.2.0.0 VVV: Rebuild script.
Attached the new versión
(If some movie fails, please send me the title, the bad information and the search language. Thank you.)
(Edito: New version down)
-
CHANGE LOG (27/12/2014):
V 0.2.0.1 VVV: Add (needs Custom Field ~FilmAffinity_Votes~) for 'votos'
Attached the new versión
(Edito: New version down)
-
Script only display the search results, but does not transfer any information for any movie, because it is always redirected to the search results, but not the movie page of the search of the movie. No transfer of any url address.
-
CHANGE LOG (28/12/2014):
V 0.2.0.2 VVV: Fixed bug with movie first search and download (Ivek23 detected)
Attached the new versión
(Edito: New version down)
Thanks Ivek23
-
CHANGE LOG (31/01/2015):
V 0.2.1.0 VVV: Adjust WEB_SPECIFIC to new API (AKA Bouton).
Attached the new versión
(Edito: New version down)
-
Work fine , tnks ;D
-
Work fine , tnks ;D
+1
-
This plugin needs an update in Director and rating.
-
CHANGE LOG (12/09/2015):
V 0.2.1.2 VVV: Adjust to new API ('Año'=year,'ratingValue'=orating,'ratingCount'=FilmAffinity_Votes,'Director'=Directors)
Only direct Movies: Don't work the list in "Advanced Search" because now it's a Google script.
Attached the new versión.
(Edito: New version down)
Thanks jippo.
-
additional rating dont work
-
It works fine on my computer. ???
What Windows and language are you using?
Your decimal separator is point (international) or comma (spanish)?
Thanks for your information.
-
windows 8.1, language spanish
worked perfectly, but one day stopped working , rename the category but does not put the stars
-
CHANGE LOG (22/11/2015):
V 0.2.1.3 VVV: Writes 'ratingValue'=orating with point english separator for better standarisation.
Eliminate "2014" from name.
Attached the new versión.
(Edito: New version down)
-
The plugins has problems in actors and description.
-
yes, description and actors dont work
-
script code:
//Get ~description~
curPos:=Pos('<dt>Sinopsis</dt>',HTML)+Length('<dt>Sinopsis</dt>'); //WEB_SPECIFIC
curPos:=PosFrom('<dd>',HTML,curPos)+Length('<dd>'); //WEB_SPECIFIC
endPos:=PosFrom('</dd>',HTML,curPos); //WEB_SPECIFIC
ItemValue:=Copy(HTML,curPos,endPos-curPos);
ItemValue:=StringReplace(ItemValue,'(FILMAFFINITY)','',True,True,False); //WEB_SPECIFIC
ItemValue:=RemoveTags(ItemValue,False);
AddFieldValueXML('description',ItemValue);
LogMessage(' Get result description:'+ItemValue+'||');
Page:
<dt>Sinopsis</dt>
<dd itemprop="description">Año 1823. En las profundidades de la América salvaje, el explorador Hugh Glass (Leonardo DiCaprio) participa junto a su hijo mestizo Hawk en una expedición de tramperos que recolecta pieles. Glass resulta gravemente herido por el ataque de un oso y es abandonado a su suerte por un traicionero miembro de su equipo, John Fitzgerald (Tom Hardy). Con la fuerza de voluntad como su única arma, Glass deberá enfrentarse a un territorio hostil, a un invierno brutal y a la guerra constante entre las tribus de nativos americanos, en una búsqueda implacable para conseguir vengarse. (FILMAFFINITY)</dd>
if someone puts the solution here , I would implement, if necessary any more information I search
-
This part of the script code,
curPos:=PosFrom('<dd>',HTML,curPos)+Length('<dd>'); //WEB_SPECIFIC
replace this part of the script code:
curPos:=PosFrom('<dd itemprop="description">',HTML,curPos)+Length('<dd itemprop="description">'); //WEB_SPECIFIC
This is will to done in the script and you will can done test if it really works.
-
does not work, shows this
-
does not work, shows this
It absolutely works, even for you there is something wrong with correcting scripts, because it is 100% works for me.
Try the attached script, which I just mentioned above, this part of the updated and correctly transferred to the description such as a web page.
-
I reinstall the program.
Description works me fine, but actors and genre not.
-
Description works me fine, but actors and genre not.
Actors and genre, now it should work properly.
Corrected script is attached.
-
I have problems in some genres.
In others works fine.
-
I have problems in some genres.
Now it should work properly.
Corrected script is attached.
-
Description doesn't work fine if it is empty.
-
Description doesn't work fine if it is empty.
Yes, I am aware of this problem, unfortunately, it is currently I can not fix.
-
Description doesn't work fine if it is empty.
Yes, I am aware of this problem, unfortunately, it is currently I can not fix.
Yeah, now I managed to fix it. Now it should work properly.
Check the attached script.
-
Sorry :'(, I had not seen so many emails (I added in the script the link of a contact Web for quick alert)
Thank very much, Ivek23 for maintaining the program ;D.
I tried to fix all (included the search list) and I fixed the "FilmAffinity_New_Releases.psf" script too.
CHANGE LOG (22/05/2016):
V 0.2.1.4 VVV: Adjust WEB_SPECIFIC to new API.
Contact Web: http://contactbyweb.com/vvv-easy
Attached the new version.
(Edito: New version down)
Thanks Am-rA and jippo, too.
-
Thank very much, Ivek23 for maintaining the program ;D.
You are Welcome and thank you.
Attached the new version.
Thank you for the new version.
-
I have a problem.
-
Ivek thank people like you is what makes it good that Internet is to remain standing :D
-
Ivek thank people like you is what makes it good that Internet is to remain standing :D
Thanks, Am-rA
-
I have a problem.
The solution to this problem is decorated.
I fixed this problem:
This is added to the code:
ItemList:=StringReplace(ItemList,'<div class="credits">','',True,True,False); //WEB_SPECIFIC
ItemList:=StringReplace(ItemList,'<span>','',True,True,False); //WEB_SPECIFIC
ItemList:=StringReplace(ItemList,'</span>','',True,True,False); //WEB_SPECIFIC
ItemList:=StringReplace(ItemList,'</div>','',True,True,False); //WEB_SPECIFIC
Corrected code is such now:
//Get ~Writers~ (Only name in Web from !name! list).
curPos:=Pos('<dt>Guión</dt>',HTML); //WEB_SPECIFIC
if 0<curPos then begin
curPos:=curPos+Length('<dt>Guión</dt>'); //WEB_SPECIFIC
curPos:=PosFrom('<dd>',HTML,curPos)+Length('<dd>'); //WEB_SPECIFIC
endPos:=PosFrom('</dd>',HTML,curPos); //WEB_SPECIFIC
ItemList:=Copy(HTML,curPos,endPos-curPos);
ItemList:=StringReplace(ItemList,'<div class="credits">','',True,True,False); //WEB_SPECIFIC
ItemList:=StringReplace(ItemList,'<span>','',True,True,False); //WEB_SPECIFIC
ItemList:=StringReplace(ItemList,'</span>','',True,True,False); //WEB_SPECIFIC
ItemList:=StringReplace(ItemList,'</div>','',True,True,False); //WEB_SPECIFIC
LogMessage(' Parse results List Writers:'+ItemList+'||');
curPos:=1; //WEB_SPECIFIC
endPos:=PosFrom(', ',ItemList,curPos); //WEB_SPECIFIC
if 0=endPos then ItemValue:=Copy(ItemList,curPos,1+Length(ItemList)-curPos);
While 0<endPos do begin
ItemValue:=Copy(ItemList,curPos,endPos-curPos);
AddMoviePerson(ItemValue,'','','',ctWriters);
LogMessage(' Get results Writers:'+ItemValue+'||');
curPos:=endPos+Length(', '); //WEB_SPECIFIC
endPos:=PosFrom(', ',ItemList,curPos); //WEB_SPECIFIC
if 0=endPos then ItemValue:=Copy(ItemList,curPos,1+Length(ItemList)-curPos);
end;
AddMoviePerson(ItemValue,'','','',ctWriters);
LogMessage(' Get results Writers:'+ItemValue+'||');
end;
//Get ~Composers~ (Only name in Web from !name! list).
curPos:=Pos('<dt>Música</dt>',HTML); //WEB_SPECIFIC
if 0<curPos then begin
curPos:=curPos+Length('<dt>Música</dt>'); //WEB_SPECIFIC
curPos:=PosFrom('<dd>',HTML,curPos)+Length('<dd>'); //WEB_SPECIFIC
endPos:=PosFrom('</dd>',HTML,curPos); //WEB_SPECIFIC
ItemList:=Copy(HTML,curPos,endPos-curPos);
ItemList:=StringReplace(ItemList,'<div class="credits"><span>','',True,True,False); //WEB_SPECIFIC
ItemList:=StringReplace(ItemList,'</span></div>','',True,True,False); //WEB_SPECIFIC
LogMessage(' Parse results List Composers:'+ItemList+'||');
curPos:=1; //WEB_SPECIFIC
endPos:=PosFrom(', ',ItemList,curPos); //WEB_SPECIFIC
if 0=endPos then ItemValue:=Copy(ItemList,curPos,1+Length(ItemList)-curPos);
While 0<endPos do begin
ItemValue:=Copy(ItemList,curPos,endPos-curPos);
AddMoviePerson(ItemValue,'','','',ctComposers);
LogMessage(' Get results Composers:'+ItemValue+'||');
curPos:=endPos+Length(', '); //WEB_SPECIFIC
endPos:=PosFrom(', ',ItemList,curPos); //WEB_SPECIFIC
if 0=endPos then ItemValue:=Copy(ItemList,curPos,1+Length(ItemList)-curPos);
end;
AddMoviePerson(ItemValue,'','','',ctComposers);
LogMessage(' Get results Composers:'+ItemValue+'||');
end;
.
.
.
//Get ~studio~ (several values in a comma separated list)
curPos:=Pos('<dt>Productora</dt>',HTML); //WEB_SPECIFIC
if 0<curPos then begin
curPos:=curPos+Length('<dt>Productora</dt>'); //WEB_SPECIFIC
curPos:=PosFrom('<dd>',HTML,curPos)+Length('<dd>'); //WEB_SPECIFIC
endPos:=PosFrom('</dd>',HTML,curPos); //WEB_SPECIFIC
ItemList:=Copy(HTML,curPos,endPos-curPos);
ItemList:=StringReplace(ItemList,';',',',True,True,False); //WEB_SPECIFIC. For Conuntry coproductions.
ItemList:=StringReplace(ItemList,' /',',',True,True,False); //WEB_SPECIFIC
ItemList:=StringReplace(ItemList,'<div class="credits"><span>','',True,True,False); //WEB_SPECIFIC
ItemList:=StringReplace(ItemList,'</span></div>','',True,True,False); //WEB_SPECIFIC
AddFieldValueXML('studio',ItemList);
LogMessage(' Get results studio:'+ItemList+'||');
end;
As well as the situation in the version of the script, and otherwise it is wrong//Script data
SCRIPT_VERSION = '0.2.1.3';and this is correct
//Script data
SCRIPT_VERSION = '0.2.1.4';
I fixed the Description code because the script writer did not follow my correction in the previous version of the script.
Description doesn't work fine if it is empty.
Yes, I am aware of this problem, unfortunately, it is currently I can not fix.
Yeah, now I managed to fix it. Now it should work properly.
Check the attached script.
Old code //Get ~description~
curPos:=Pos('<dt>Sinopsis</dt>',HTML)+Length('<dt>Sinopsis</dt>'); //WEB_SPECIFIC
curPos:=PosFrom('<dd itemprop="description">',HTML,curPos)+Length('<dd itemprop="description">'); //WEB_SPECIFIC
endPos:=PosFrom('</dd>',HTML,curPos); //WEB_SPECIFIC
ItemValue:=Copy(HTML,curPos,endPos-curPos);
ItemValue:=StringReplace(ItemValue,'(FILMAFFINITY)','',True,True,False); //WEB_SPECIFIC
ItemValue:=RemoveTags(ItemValue,False);
AddFieldValueXML('description',ItemValue);
LogMessage(' Get result description:'+ItemValue+'||');
New code //Get ~description~
curPos:=Pos('<dt>Sinopsis</dt>',HTML); //WEB_SPECIFIC
if 0<curPos then begin
curPos:=curPos+Length('<dt>Sinopsis</dt>'); //WEB_SPECIFIC
curPos:=PosFrom('<dd itemprop="description">',HTML,curPos)+Length('<dd itemprop="description">'); //WEB_SPECIFIC
endPos:=PosFrom('</dl>',HTML,curPos); //WEB_SPECIFIC
ItemValue:=Copy(HTML,curPos,endPos-curPos);
ItemValue:=StringReplace(ItemValue,'(FILMAFFINITY)','',True,True,False); //WEB_SPECIFIC
ItemValue:=RemoveTags(ItemValue,False);
AddFieldValueXML('description',ItemValue);
LogMessage(' Get result description:'+ItemValue+'||');
end;
Check the attached script.
-
Problems with composer.
-
Problems with composer.
I fixed the problems.
Check the attached script.
-
The script doesnt work me.
Filmaffinity changes his search.
-
The script doesnt work me.
Filmaffinity changes his search.
On the link below please report the error.
Contact Web: http://contactbyweb.com/vvv-easy
-
Sorry :'(, I had not seen so many emails (I added in the script the link of a contact Web for quick alert)
Thank very much, Ivek23 for maintaining the program ;D.
I have consolidated the Ivek23 version and fix the search new API
CHANGE LOG (06/06/2016):
V 0.2.1.6 VVV: Adjust WEB_SPECIFIC to new API (Problems with search with several results).
V 0.2.1.5 Ivek23: Adjust WEB_SPECIFIC to new API (Problems with composer).
Attached the new version.
FilmAffinity_New_Releases.psf
Need: Search in FilmAffinity DVD rental films the movies with a rating higher of 6 and number of votes greater than 2000.
Problem to solve: Select from a web list and then gets information (for instance, number of votes) of those movies.
Characteristics of Script: A script of multiple passes. Search the list page (stored in the first access) and while the list is parsed, gets the pages from the good movies to get more information (searches similar to "FilmAffinity_[ES]"). All is saved to a file. If GET_ONLY_NOT_PVdB = True, gets only the movies not present in PVdB (but PVdb_CSVDB_FILE is needed). Although not very smart, use global variables for better understanding.
Attached the new version too.
(Edito: New versions down)
-
Thank very much, Ivek23 for maintaining the program ;D.
Welcome and thanks for the new version.
I have consolidated the Ivek23 version and fix the search new API
CHANGE LOG (06/06/2016):
V 0.2.1.6 VVV: Adjust WEB_SPECIFIC to new API (Problems with search with several results).
V 0.2.1.5 Ivek23: Adjust WEB_SPECIFIC to new API (Problems with composer).
Attached the new version.
-
Update:
CHANGE LOG (17/09/2016):
V 0.2.1.7 VVV: Adjust WEB_SPECIFIC to new API (Problems with search with several results: Choice of order, No poster).
Attached the new version.
(Edito: New versions down)
-
Update:
CHANGE LOG (17/09/2016):
V 0.2.1.7 VVV: Adjust WEB_SPECIFIC to new API (Problems with search with several results: Choice of order, No poster).
Attached the new version.
Thanks for the new version.
-
This script needs an update.
-
Update:
CHANGE LOG (25/09/2016):
V 1.1.0.0 VVV: Use the RemoveTags function for scrap. New "CleanBeginEndSpaces" user function.
Attached the new version.
Thanks jippo (jdr___@hotmail.com) by the alert.
(Edito: New versions down)
-
Update:
CHANGE LOG (25/09/2016):
V 1.1.0.0 VVV: Use the RemoveTags function for scrap. New "CleanBeginEndSpaces" user function.
Attached the new version.
Thanks jippo (jdr___@hotmail.com) by the alert.
Thanks.
-
Update:
CHANGE LOG (20/10/2016):
V 1.2.0.0 VVV: Clean code with TextBetWeen (RemoveTags not needed) and ExplodeString functions. Use of TWideArray variable type.
Use 'Trim' PDV funtion in place of "CleanBeginEndSpaces" user function.
Attached the new version.
(Edito: New versions down)
-
The script doesn't work.
It doesn't import nothing.
-
Update:
CHANGE LOG (29/10/2016):
V 1.3.0.0 VVV: Managed redirected film pages in search mode. Added search stored URL (if present) in 'GetDownloadURL' function.
Attached the new version.
Thanks jippo (jdr___@hotmail.com) for the alert.
(Edito: New versions down)
-
:-* tnks
-
Update:
V 1.3.1.0 (12/10/2016) VVV: Clean ~Director~ '(creator)', ~Writers~ '(artículo:)''(historia:)''(libros:)''(novela:)''(novelas:)''(obra:)' and ~Composers~ '(canción:)''(canciones:)''(tema:)''(aka)'
Attached the new version.
(Edito: New versions down)
-
Update:
CHANGE LOG :
V 1.3.1.1 (12/10/2016) VVV: Added clean ~Writers~ of 'cómic:' and 'libro:'. Separated the '(' ')' elimination for get all cases.
Attached the new version.
(Edito: New versions down)
-
New error with this plugin.
This page is using HTTPS now.
-
Well, I think this is a "Chronicle of a Death Foretold".
Fortunately, I'd tested the curl solution with Rottentomatoes_ [HTTPS] script.
I must search a time to adapt it, not too later because I use it.
Stay tuned.
-
FilmAffinity_[ES][HTTPS] is here.
To adapt PVdB for downloading https pages you Needed external:
1) Download the curl-7.54.0-win32-mingw.7z file from https://bintray.com/artifact/download/vszakats/generic/curl-7.54.0-win32-mingw.7z (https://bintray.com/artifact/download/vszakats/generic/curl-7.54.0-win32-mingw.7z) (Thanks Viktor Szakáts).
2)Extract the three curl libraries files and copy them to script folder:
• curl-7.54.0-win32-mingw\bin\curl.exe
• curl-7.54.0-win32-mingw\bin\curl-ca-bundle.crt
• curl-7.54.0-win32-mingw\bin\libcurl.dll
(You can see curl - PVD to https solution (http://www.videodb.info/forum_en/index.php/topic,4070.0.html) for more information)
-
Update:
CHANGE LOG :
V 2.0.0.0 (24/05/2017) VVV: HTTPS adaptation: Now GET PVdB function don't donwload the page.For do that it use curl free program https://curl.haxx.se.
Change a "filmaffinity.com/es/advsearch" instead of "filmaffinity.com/es/search" in order to avoid the auto redirection when only one movie are posible
Fixed "Productor" or "Producer" present in some studio fields.
User Options added: CHECK_WEBSITE = Set to True add to SearchResult List the true HTTPS links 'Just to check the website'.
SEARCH_ENGINE = Set to True, if there isn't FilmAffinity search results, try with Bing search engine.
Attached the new version.
(Edito: New versions down)
-
Thnks :D (muchas gracias)
-
There is a problem, if the title has unusual accents or symbols it hangs up the program.
Ej : Børning 2 (error)
Ej : Borning 2 (fine)
Ej : Cincuenta Sombras Más Oscuras (error)
Ej : Cincuenta Sombras Mas Oscuras (fine)
-
Update:
CHANGE LOG :
V 2.0.0.1 (14/06/2017) VVV: Fixed bug with UTF-8 conversion. Now the function "DownloadPage" with curl works faster.
Attached the new version.
Thank you for the alert, Am-rA :)
(Edito: New versions down)
-
You do not have to give them, thanks to you for continuing to maintain what is still undoubtedly the best program to catalog movies, thanks to these arrangements of yours, we still use a few.
;)
-
Update:
CHANGE LOG :
V 3.0.0.0 (08/10/2017) VVV: Download with the Windows PowerShell (not external files needed and is faster).
But if you want use curl.exe change the setting USE_CURL = True
Attached the new version.
IMPORTANT NOTE: Some Win 8.1 users has problems with the PowerShell version, so, if you have problems, you may open the "FilmAffinity_[ES][HTTPS].psf" with notepad and change the setting to USE_CURL = True in line 123.
(Edito: New versions down)
-
Thanks :D
-
Update:
CHANGE LOG :
V 2.0.0.1 (14/06/2017) VVV: Fixed bug with UTF-8 conversion. Now the function "DownloadPage" with curl works faster.
Attached the new version.
Thank you for the alert, Am-rA :)
(Edito: New versions down)
we again have the same problem
Ex: El Hombre Del Corazón De Hierro
-
I don't be able to reproduce the problema. I need some information:
1)¿You use the Powershell versión (v.3.0.0.0 not changed) or the curl versión (v.3.0.0.0 with the setting USE_CURL = True)
2) If first (Powershell):
¿what Windows lenguaje and version you use?
¿can you try with curl versión (edit with noteblock "FilmAffinity_[ES][HTTPS].psf" and change the setting USE_CURL = True)
3) If second (curl):
¿can you try with PowerShell version? (edit with noteblock "FilmAffinity_[ES][HTTPS].psf" and change the setting USE_CURL = False)
-
I don't be able to reproduce the problema. I need some information:
1)¿You use the Powershell versión (v.3.0.0.0 not changed) or the curl versión (v.3.0.0.0 with the setting USE_CURL = True)
2) If first (Powershell):
¿what Windows lenguaje and version you use?
¿can you try with curl versión (edit with noteblock "FilmAffinity_[ES][HTTPS].psf" and change the setting USE_CURL = True)
3) If second (curl):
¿can you try with PowerShell version? (edit with noteblock "FilmAffinity_[ES][HTTPS].psf" and change the setting USE_CURL = False)
Test - El Hombre Del Corazón De Hierro
v.3.0.0.0 Windows 8.1
Powershell - don´t work
USE_CURL=True - Work Fine
other titles worked without problems, if I find another title that has that problem I will tell it
-
Thank you, I use win10 - ESP, perhaps this is the diference.
¿Can you post the "downpage-UTF8_NO_BOM.htm" file in the Powershell fail mode (you must zipped it by the fórum limitations, you can see my file attached)?
In fact, one time this title has need the bing search mode to find the FilmAffinity URL, but after chose it, it download without problem in Powershell mode.
-
Forget the last message.
I think that I can improve the search function.
If you need, for the moment, use the curl version.
Stay tuned.
-
Ok, anything, you tell me
thanks
in case you also need
-
Update:
CHANGE LOG :
V 3.0.0.1 (31/10/2017) VVV: Set "escaped" UTF-8 codification for the ANSI char of URL in the function "DownloadPage".
Attached the new version.
IMPORTANT NOTE: Some Win 8.1 users has problems with the PowerShell version, so, if you have problems, you may open the "FilmAffinity_[ES][HTTPS].psf" with notepad and change the setting to USE_CURL = True in line 124.
(Edito: New versions down)
-
It doesn't import the director.
-
Update:
CHANGE LOG :
V 3.0.0.2 (09/12/2017) VVV: Adjust to new API ('<dt>Dirección</dt>' in the place of '<dt>Director</dt>'). Search routine improvements
IMPORTANT NOTE: Some Win 8.1 users has problems with the PowerShell version, so, if you have problems, you may open the "FilmAffinity_[ES][HTTPS].psf" with notepad and change the setting to USE_CURL = True in line 125.
(Edito: New versions down)
-
Update:
CHANGE LOG :
V 3.0.0.3 (04/02/2018) VVV: Detects not or very slow internet conexion with INTERNET_TEST_ITERATIONS parameter.
Attached the new version.
IMPORTANT NOTE: Sometimes PVD crash in the first PowerShell run. Push "Continue Application" and try another time.
Some Win 8.1 users has problems with the PowerShell version, if you have the same problems then use CURL modality: you may open the "FilmAffinity_[ES][HTTPS].psf" with notepad and change the setting to USE_CURL = True in line 126 with the CURL files in the script folder.
(Edito: New versions down)
-
Update:
CHANGE LOG :
V 4.0.0.0 (05/05/2018) VVV: New specific program for download PVdBDownPage.exe
Attached the new versión and in the following link:
(Edito: New versions down)
IMPORTANT NOTE: Changed the script distribution: All needed files in Script folder are zipped in the distributed file.
-
Update:
CHANGE LOG :
V 4.0.0.0 (05/05/2018) VVV: New specific program for download PVdBDownPage.exe
Attached the new versión and in the following link:
http://vvveasy.altervista.org/wp-content/uploads/2018/05/FilmAffinity_ESHTTPS_V_4_0_0_0.zip (http://vvveasy.altervista.org/wp-content/uploads/2018/05/FilmAffinity_ESHTTPS_V_4_0_0_0.zip)
IMPORTANT NOTE: Changed the script distribution: All needed files in Script folder are zipped in the distributed file.
Unfortunately, this does not work with me at all, I am reporting an error that I do not have an internet connection (several errors in the Internet connection) or a blocked IP address.
-
¿Do you have PVD with Proxomiton active?
If yes, try with Proxomiton not running.
-
¿Do you have PVD with Proxomiton active?
If yes, try with Proxomiton not running.
This happens every time, when Proxomiton is active, as well as when Proxomiton is not active. This happens with the PVD 0.9.9.21 version as well 1.0.2.7 version.
-
Update:
CHANGE LOG :
V 4.0.0.1 (06/05/2018) VVV: Bugs correction and new version of PVdBDownPage with logging function
Attached the new versión and in the following link too:
http://vvveasy.altervista.org/wp-content/uploads/2018/05/FilmAffinity_ESHTTPS_V_4_0_0_1.zip (http://vvveasy.altervista.org/wp-content/uploads/2018/05/FilmAffinity_ESHTTPS_V_4_0_0_1.zip)
IMPORTANT NOTES.
Works in Win10 and perhaps in Win8. Fails in Win7.
Changed the script distribution: All needed files for PersonalVideoDB in the Scripts folder are zipped in the distributed file.
-
¿Do you have PVD with Proxomiton active?
If yes, try with Proxomiton not running.
This happens every time, when Proxomiton is active, as well as when Proxomiton is not active. This happens with the PVD 0.9.9.21 version as well 1.0.2.7 version.
Hello, Ivek. This version don't conrrect your problem but allows me to analyze.
Please, ¿may you do the following steps?
1) Install the new script version (all files)
2) Run (doble mouse click) "PVdBDownPage.exe" ¿it shows the help message box or you have problems with Windows security?
2) If it works, create a empty text file "PVdBDownPage.log" in the Scripts folder (the same that PVdBDownPage.exe)
3) Make several test (the log file saves the url's). You can edit with notepad.
4) Post me it in the forum in order to anlyze.
Thank you very much for your help.
If others users have problems ??? or works ok :), please tell us ;D
-
downpage-UTF8_NO_BOM.htm file is empty until I make a cancellation. After the search result is displayed, the file is not empty. Then the file disappears and again appears empty or in some cases it does not show up anymore.
PVdBDownPage.log 7z file and sshot-1a 7z file added.
-
sshot-1b 7z file added.
-
sshot-1c 7z file added.
-
Thank you very much, Ivek.
Bad news, I think that the problem is with the OS Win 7 and the new protocol TLS 1.2. (I use Win10)
(See https://stackoverflow.com/questions/44045305/vba-an-error-occurred-in-the-secure-channel-support (https://stackoverflow.com/questions/44045305/vba-an-error-occurred-in-the-secure-channel-support))
If you can run directly in the script folder with the cmd windows:
PVdBDownPage.exe "https://www.filmaffinity.com/es/film554692.html" "tes1_downpage.htm"
and
PVdBDownPage.exe "https://www.themoviedb.org/movie/213/" "test2_downpage.htm"
If the first fails (not download) and the second works (file test2_downpage.htm full) the problem is confirmed.
The program solution is not easy, ¿the curl.exe ancient solution works in your Win7?
-
If you can run directly in the script folder with the cmd windows:
PVdBDownPage.exe "https://www.filmaffinity.com/es/film554692.html" "tes1_downpage.htm
No (file test1_downpage.htm not download).
If you can run directly in the script folder with the cmd windows:
PVdBDownPage.exe "https://www.themoviedb.org/movie/213/" "test2_downpage.htm"
Yes (file test2_downpage.htm full download).
-
In the following url I save the file "PVdBDownPage_for_Win7" with a patch for the problem.
http://vvveasy.altervista.org/wp-content/uploads/2018/05/PVdBDownPage_for_Win7.zip (http://vvveasy.altervista.org/wp-content/uploads/2018/05/PVdBDownPage_for_Win7.zip)
The script no change but the auxiliar PVdBDownPage.exe use curl.exe for download in the place of his own funtion.
Save the four files in the Scripts folders and try (in my Win7 the patch works).
-
In the following url I save the file "PVdBDownPage_for_Win7" with a patch for the problem.
http://vvveasy.altervista.org/wp-content/uploads/2018/05/PVdBDownPage_for_Win7.zip (http://vvveasy.altervista.org/wp-content/uploads/2018/05/PVdBDownPage_for_Win7.zip)
The script no change but the auxiliar PVdBDownPage.exe use curl.exe for download in the place of his own funtion.
Save the four files in the Scripts folders and try (in my Win7 the patch works).
Thank you for your efforts. This version also does not work on my Windows 7 Ultimate OS. Obviously, that the new TLS 1.2 protocol does not work on my outdated Win 7 OS. Your script V 3.0.0.0 and other V 3.0 did not work with me. Also, new script versions will not work in the future, because I have not been thinking of switching to Windows 10 OS for a long time (so far for my work, which I do on the computer is more than excellent OS - Win 7).
-
If you have patched the script with the four files of the "PVdBDownPage_for_Win7.zip" file (save in Script folder, overwriting the original PVdBDownPage.exe and adding the curl files).
¿Can you make some test and sending me the "PVdBDownPage.log"? The screen shots aren't necessary.
I'm very interested in the solution of this problem because I'm working [HTTPS] in a PVD MOD version with three scripts :
1) Basic IMDB [HTTPS] (but easily up-size-able)
2) Filmaffinity [ES][HTTPS] (and perhaps [EN] too)
3) TheMovieDB_[ES][API] (and surely [EN] [FR] too)
I think that with this three script is possible make others for all webs.
-
If you have patched the script with the four files of the "PVdBDownPage_for_Win7.zip" file (save in Script folder, overwriting the original PVdBDownPage.exe and adding the curl files).
¿Can you make some test and sending me the "PVdBDownPage.log"? The screen shots aren't necessary.
PVdBDownPage1.log 7z file added.
-
At least, I don't see any exception TSL1.2 ;) ¿has you remember use PVDB without Proxomiton?
After apply script to a movie:
¿the "downpage-UTF8_NO_BOM.htm" file is empty?
-
At least, I don't see any exception TSL1.2 ;) ¿has you remember use PVDB without Proxomiton?
After apply script to a movie:
¿the "downpage-UTF8_NO_BOM.htm" file is empty?
Proxomiton was not started when I tested the FilmAffinity_[ES][HTTPS] script.
Yes, "downpage-UTF8_NO_BOM.htm" file is empty. More precisely, "downpage-UTF8_NO_BOM.htm" file in the PVD 0.9.9.21 version as well as in 1.0.2.7 version it was no longer possible to see. If I added it before starting the script, it immediately disappeared and did not show up immediately when the script was started.
PVdBDownPage.log txt file from 1.0.2.7 versio I added here.
-
Thank you very much Ivek. ;D
I'm working in a PVD MOD versión with the patch included more easy to try.
Stay tunned.
-
Could you please share the last curl version of your script? Thank You!
-
This topic to update FilmAffinity is nearly to close.
But don't worry, Ivek23 and me, we are in the aventure of make a Personal Video Database MOD fully funtional in the
Topic "Alternative":
http://www.videodb.info/forum_en/index.php?topic=4126.msg20555#msg20555 (http://www.videodb.info/forum_en/index.php?topic=4126.msg20555#msg20555)
If you want to help us, you can be a Beta tester:
1) Make a copy of you Personal Video DataBase folder and delete the "Plugins" and "Script" folders
2) Download and unzip the MOD version
3) Copy "Plugins" and "Script" folders of the MOD version in your copy of your collection
4) Test it.
And you can tell us your experience. ;D
-
Happily, we have finished the "Beta" phase in the PVD MOD and move on to "Release" state.
So, we closed this topic now and we continue in the new topic:
Personal Video Database 1.0.2.7 MOD
http://www.videodb.info/forum_en/index.php/topic,4134.0.html (http://www.videodb.info/forum_en/index.php/topic,4134.0.html)
See you all there. ;D