Show Posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.


Messages - afrocuban

Pages: 1 [2] 3 4 5 6 7 ... 32
21
As of March 13, 2025 Selenium IMDb Movie, People and FilmAffinity Movie scripts, vbs script and Scripts Configurator for them completed. Read the first message about the details as well as how and where to get them.

22
Support / Re: IMDb
« on: March 13, 2025, 09:19:24 am »


PVD mod v1.0.2.7 no longer retrieving data from IMDB.com to update the database even after the url for the movies is set .

Then use the import button with IMDB_[EN][HTTPS]_TEST_1.psf set to retrieve the data. 
This use to work but now no longer does whats up with this.


Below is the above .pst script that use to work after inputting the found imdb's url for the movie can be download from below:


I have finally finished Selenium scripts and will share them on this forum
https://www.videodb.info/forum_en/index.php/board,16.0.html

23
Talk / Re: Donations to Ivek
« on: March 13, 2025, 09:17:25 am »
In your time of sorrow, I would like to extend my heartfelt condolences to you and your family. May your mother’s soul rest in peace.

24
PVD Python Scripts / Re: IMDB_[EN][HTTPS]_TEST_Aka (+Selenium) script
« on: February 17, 2025, 09:15:20 pm »
It is not possible at the moment, wait for the Afrocuban user to make the scripts and upload them for testing. I am not currently involved in anything related to PVD for personal reasons (my mother is in the hospital with serious health problems). How long this will take, I do not know, so I need to use this time to solve the problem that has arisen.

I wish your mother to get well as soon as possible!!!

Thanks, but considering she's 88 + and her health condition, it doesn't look good.

You've been with us all these years. It's time for us to be with you. At least in our prayers her to get better.

25
PVD Python Scripts / Re: IMDB_[EN][HTTPS]_TEST_Aka (+Selenium) script
« on: February 17, 2025, 03:20:29 pm »
this is too complicated instruction for a person who is not a programmer  ??? :'( :'( :'( :'(

I am living example it is not if you are willing and determined enough.  ;D ;)

I am so far from programming, as the JADES-GS-z14-0 is far from the Earth, yet I'm here creating scripts...

26
New advances in the first post as of  February 16th 2025.

27
PVD Python Scripts / Re: IMDB_[EN][HTTPS]_TEST_Aka (+Selenium) script
« on: February 17, 2025, 02:16:16 pm »
this is too complicated instruction for a person who is not a programmer  ??? :'( :'( :'( :'(
Is it possible to create a bat-file into which I could insert the necessary paths myself?

Be patient please. I am preparing all-in-one script for IMDbMovie, another for IMDBPeople and another for Filmaffinity. if you read the whole topic here, after that you won't need any other .psf script than 3 of these for the resources. Follow updates based on the last dates (colored sections), you find in the first message there.

28
PVD Python Scripts / Re: IMDB_[EN][HTTPS]_TEST_Aka (+Selenium) script
« on: February 17, 2025, 02:11:11 pm »
It is not possible at the moment, wait for the Afrocuban user to make the scripts and upload them for testing. I am not currently involved in anything related to PVD for personal reasons (my mother is in the hospital with serious health problems). How long this will take, I do not know, so I need to use this time to solve the problem that has arisen.

I wish your mother to get well as soon as possible!!!

29
News is that I adapted ParsePage_IMDBMovieCREDIT to parse either from reference or fullcredits page based on a new script option:
Quote
  GET_FULL_CREDIT_FROM_REFERENCE      =   True;   //Instead from FullCredits.htm page with Function ParsePage_IMDBMovieCREDIT, download full credits from Reference.htm with  Function ParsePage_IMDBMovieCREDIT.


This way we optimize the time and load, by not downloading and parsing fullcredits page. But if we set the option to "False", then it will download fullcredits page, and with the same Function ParsePage_IMDBMovieCREDIT, without any code changes, it will parse fullcredits page and get the exact same result as when this function parses reference.htm page.



30
I am preparing 3 scripts: IMDb Movie, People and FilmAffinity that I will publish all together, so people could test them all. I don't want to publish them separately, because I can't work on them, and to make updates on published scripts in parallel. I guess I am a week from the publishing. Thanks for patience, but Movie script now has almost 7000 lines...

31
Function ParsePage_IMDBMovieREFERENCE gives me a lot of headache because of a huge redudancy and overlapping potential with ParsePage_IMDBMovieBASE and ParsePage_IMDBMovieCREDIT, which is not good for time optimization. But it's a great resource, so I am at the moment occupied with reorganization of Base and Credit not to parse when reference page is downloaded, while adding everything from both to parse from reference page that is redudant for base and credit. Will check for redudancy for other pages later too.

32
PVD Python Scripts / Re: Downloading with Selenium experiences and tips
« on: February 08, 2025, 04:07:38 am »

I couldn't seem to download .htm and get "Storyline" section from the main page. Nothing helped that I tried. Even .mhtml couldn't catch it.


Then I tried it in a non-headless mode and succeeded. What was different? Scrolling! But not to the bottom of the page, but specifically to the storyline section:


Code: [Select]
                # Scroll down to the Storyline section
                storyline_section = driver.find_element(By.XPATH, "//*[@id='__next']/main/section[1]/section[1]/section[6]")
                driver.execute_script("arguments[0].scrollIntoView();", storyline_section)
                logging.info("Scrolled to the Storyline section.")


                # Adding a delay to ensure content loads
                time.sleep(3)

Adjusting the time helps depending of your connection and how old your computer is.

Now this might help to avoid downloading and parsing reference page... Yet to analyze.

But the point of the topic was to emphasize another way of getting dynamic conent of the page... Share your tips here too...

33
PVD Python Scripts / Downloading with Selenium experiences and tips
« on: February 08, 2025, 03:58:26 am »
Share your tips here...

34
New advances in the first post as of February 6th 2025.

35
New advances in the first post on February 1st 2025.

36
PVD Python Scripts / Re: New IMDb People v4 Script Discussion
« on: February 01, 2025, 07:50:45 pm »
Oh, good to know, thanks! Does vbs script used only to delete tmp files affect chosen browser? Popups we had so far were happening only while cmd.exe were trying to delete downpage-UTF8_NO_BOM.htm, they had nothing to do with downloading it, so that is why I'm confused what I'm missing.

37
PVD Python Scripts / Re: New IMDb People v4 Script Discussion
« on: January 23, 2025, 08:18:07 pm »
I didn't know that, thanks. I tried Powershell, ConEmu and similar in the process, even python, but none of them were good alternatives. They were even worse than cmd. So, it will create bigger problems for Microsft I can already forsee.

Anyway, it's just a snippet to silently delete files, so that will not be an issue, and we will find proper alternative.

Until then, I see no reason not to do as all others: I will follow Microsoft and I will use vbs script.

38
People Script Complete.

39
PVD Python Scripts / Re: New IMDb People v4 Script Discussion
« on: January 22, 2025, 07:58:00 pm »
I understand. Thank you. It will be anyway easy to customize script to move the data back to comment field. It will be a matter of simple cut/paste only.

I too started with People script because I knew it is not used that much, so i could learn along the way. As you already know many solutions from People script are almost copy/paste to other IMDb scripts. So it will be easier for me to work on other scripts. I don't tend them to be "official" scripts. I kindly offer them as a community contribution. I want to learn because I want PVD to be alive for me at least.

40
This is temp topic so you could track where am I at the moment with scripts.
Most probably I will keep only this message and modify it with most recent updates.


IMDb People script:
CHANGE LOG :

            V 4.0.0.1 (23/01/2025) afrocuban:
         - Full and complete transtion to Selenium. No more instances or references to PVdBDownPage. Huge thanks to VVVEasy and Ivek to maintain decade long option to keep PVD alive with it.
         - Search function brought back to the script with thumbnails in the search window.
         - Full implementation of PvdConfigOptions. Extremely important for optimization and especially useful when refreshing only certain set of data
         - Job Title, Career and other personal data now moved from comment to bio field.
         - Starting positions provided for all the fileds in section "Field Overwrite Options position in pvdconf.ini".
         - No more pop-up windows stealing focus! In earlier versions, the downpage-UTF8_NO_BOM.htm file was repeatedly downloaded and deleted to parse different pages. Each time this occurred, a pop-up window would steal the focus. Thanks to a different approach in this script, which now downloads separate pages in parallel using Selenium, as well as the special PurgeTmpFiles procedure and vbs script instead of cmd.exe, this focus-stealing issue is now resolved.
TO DO:

SCRIPT COMPLETE
Script and instructions available in a package here.


IMDb Movie script:
CHANGE LOG :

            V 4.0.0.1 (18/01/2025) afrocuban:
         - Transition to Selenium started.
         - Various DownloadPageXXX functions for each page to be downloaded constructed.
         - ParsePage function adapted accordingly.
         - DownloadPage and DownloadImage functions set up for Selenium scripts.
         - ParsePage_IMDBSearchTitle function fully transitioned to Selenium which means that
         - Search function is brought back to the script with thumbnails in the search window.
         - Starting positions provided for all the fileds in section "Field Overwrite Options position in pvdconf.ini".
         - No more pop-up windows stealing focus! In earlier versions, the downpage-UTF8_NO_BOM.htm file was repeatedly downloaded and deleted to parse different pages. Each time this occurred, a pop-up window would steal the focus. Thanks to a different approach in this script, which now downloads separate pages in parallel using Selenium, as well as the special PurgeTmpFiles procedure and vbs script instead cmd.exe, this focus-stealing issue is now resolved.
---------------------------------
February as of 1st 2025 news:
----------------------------------
- Script fully transitioned to Selenium.
- Script Options, Script Data and Global Vars upgraded.
- New GetPvdConfigOptions Function introduced, so now
- Whole script successfully set to rely on PVDConfigOptions.
- GetDownloadURL Function completely set and functional.
- DownloadPage Function completely set and functional.
- DownloadImage Function completely set and functional.
- ParsePage_IMDBSearchTitle Function completely set and functional.
- ParsePage_IMDBMovieBASE Function completely set and functional.
- ParsePage_IMDBMovieAWARDS Function completely set and functional. (check the screenshot here)
- ParsePage_IMDBMoviePLOTSUMMARY Function completely set and functional.
- ParsePage Function completely set and functional.


---------------------------------
February as of 6th 2025 news:
----------------------------------
- ParsePage_IMDBMovieCREDIT Function redesigned and completely set and functional.
- ParsePage_IMDBMovieAKA Function completely set and functional.
- ParsePage_IMDBMovieCONNECTIONS Function brought back to the script with additional connection type not existed in the script so far (check the screenshot here)


---------------------------------
February as of 16th 2025 news:
----------------------------------
SCRIPT BASICALLY COMPLETED

---------------------------------
March as of 13th 2025 news:
----------------------------------
SCRIPT COMPLETE
Script and instructions available in a package here.

IMDb Series Script:
Nothing yet. When I finish movie and people scripts, I will check for and assess a possibilty to merge it with episodes script.


IMDb Episodes Script:
Nothing yet. When I finish movie and people scripts, I will check for and assess a possibilty to merge it with series script.


FilmAffinity Script:
I will strip the version down to v4, and for now for testing purposes I have successfully transitioned only DownloadImage (poster) to Selenium. The plan is to fully transition it to Selenium too, but since it works perfectly at the moment, it is not priority. The transition should be fast, though, because most probably it is only needed to set Selenium scripts and switch functions to them (there are not as many functions for FA as fro IMDb scripts). Trailer page is intended to be added too.
TO DO:
SCRIPT COMPLETE
Script and instructions available in a package here.

Selenium Scripts:
Single Download base page set for IMDb Movie, People and FilmAffinity Movie. ("3 in 1")
Single Search script set for IMDb Movie, People and FilmAffinity Movie. ("3 in 1")
Single Download image script set for IMDb Movie, People and FilmAffinity Movie. ("3 in 1")

Single Download additional pages scripts set for IMDb Movie and FilmAffinity Movie. ("2 in 1")
Single Download additional pages scripts set for IMDb People.
Scripts and instructions available in a package here.


TO DO:
- To set download base page and additional pages scripts for Series and Episodes script.
- To adapt Search script for Series and Episodes.

OTHER:
- vbs script set to use instead of cmd.exe in order to avoid annoying pop-up windows stealing focus.
- SCRIPTS CONFIGURATOR completely rewritten from the scratch (yes, I had to learn about ahk, too :-\ ) so now we have resizable window with scrollbars with all the options I could think of included.
Scripts, configurator exe and source code, screenshots and instructions available in a package here.

WISHFULL THINKING:
- Bringing back Allmovie and Rottentomatoes scripts too.

Pages: 1 [2] 3 4 5 6 7 ... 32