Python download file from website

So my question is,how can I write a Python script that goes to a given stock's NASDAQ page, click on the Download file in excel format link and actually download the file from it. Most solutions online require you to know the url where the file is stored but in this case, I don't have access to that.

So how do I go about doing this? It appears that BeautifulSoup might be the easiest way to do this. I've made a cursory check that the results of the following script are the same as those that appear on the page. You would just have to write the results to a file, rather than print them. However, the columns are ordered differently. Dig a little bit deeper and find out what js function getQuotes does. You should get a good clue from that.

If it all seem too much complicated, then you can always use selenium. It is used to simulate the browser. However, it is much slower than using native network calls. You can find official documentation here. Stack Overflow for Teams — Collaborate and share knowledge with a private group. Create a free Team What is Teams? Collectives on Stack Overflow. Learn more. Python- Downloading a file from a webpage by clicking on a link Ask Question.

Asked 4 years, 8 months ago. Active 4 years, 8 months ago. Viewed 7k times. Improve this question. Google "python selenium" — Julien. From what I'm reading about it, it helps me interact with the web browser as in it will actually open up the web browser.

Do you need only the 3-month data that is provided by default? If you use the PhantomJS webdriver, it doesn't need to open a browser. BillBell Yes only the last 3 months. Doing some machine learning so data that is 20 years old isn't that helpful. Show 2 more comments. Active Oldest Votes. Click the link, and see if there was any requests made to the server If there was, click it, and see if you can reverse engineer the API of its endpoint Please be aware that this may be against the website's Terms of Service!

Improve this answer. See your article appearing on the GeeksforGeeks main page and help other Geeks. Please write comments if you find anything incorrect, or you want to share more information about the topic discussed above. Skip to content. Change Language. Related Articles. Table of Contents. Save Article. Improve Article. Like Article.

Saving received content as a png file in. URL of the archive web-page which provides link to. It would have been tiring to. In this example, we first crawl the webpage to extract. Recommended Articles. Article Contributed By :. Easy Normal Medium Hard Expert. Writing code in comment? Please use ide. Load Comments. What's New. Most popular in GBlog.