Download file from Blob URL with Python -


i wish have python script download master data (download, xlsx) excel file frankfurt stock exchange webpage.

when retrieve urrlib , wget, turns out url leads blob , file downloaded 289 bytes , unreadable.

http://www.xetra.com/blob/1193366/b2f210876702b8e08e40b8ecb769a02e/data/all-tradable-etfs-etcs-and-etns.xlsx

i'm entirely unfamiliar blobs , have these questions:

  • can file "behind blob" retrieved using python?

  • if so, necessary uncover "true" url behind blob – if there such thing – , how? concern here link above won't static change often.

that 289 byte long thing might html code 403 forbidden page. happen because server smart , rejects if code not specify user agent.

python 3

# python3 import urllib.request request  url = 'http://www.xetra.com/blob/1193366/b2f210876702b8e08e40b8ecb769a02e/data/all-tradable-etfs-etcs-and-etns.xlsx' # fake user agent of safari fake_useragent = 'mozilla/5.0 (ipad; cpu os 6_0 mac os x) applewebkit/536.26 (khtml, gecko) version/6.0 mobile/10a5355d safari/8536.25' r = request.request(url, headers={'user-agent': fake_useragent}) f = request.urlopen(r)  # print or write print(f.read())

python 2

# python2 import urllib2  url = 'http://www.xetra.com/blob/1193366/b2f210876702b8e08e40b8ecb769a02e/data/all-tradable-etfs-etcs-and-etns.xlsx' # fake user agent of safari fake_useragent = 'mozilla/5.0 (ipad; cpu os 6_0 mac os x) applewebkit/536.26 (khtml, gecko) version/6.0 mobile/10a5355d safari/8536.25'  r = urllib2.request(url, headers={'user-agent': fake_useragent}) f = urllib2.urlopen(r)  print(f.read())

-

Comments

Post a Comment

Popular posts from this blog

php - Auto increment employee ID -

Image
i want add employee , after that, employee id increment. textbox must disabled also here's code. want auto increment employee id when add new employee. hope me. thank in advance. :) <center> <form class="contact_form" action="#" method="post"> <h2>register new employee</h2> <br/> <table> <tr> <td><label for="emp">emp id:</label></td> <td><input type="text" name="emp" placeholder="emp id" required /></td> </tr> <tr> <td><label for="name">name:</label></td> <td><input type="text" name="fname" placeholder="first name" required /> <input type="text" name="lname" placehol...
Read more

php - isset function not working properly -

the page unable see login form code written under isset function statement. have written code correctly , have executed many times , code written inside isset statement not works. here code:- <?php session_start(); echo "<p style=\"font-color: #ff0000;\"> catogoies </p>"; echo '<link href="var/www/html/sample.css" rel="stylesheet">'; require_once('../html/conn.php'); $query = "select * catogories"; mysqli_select_db($dbc, 'odit'); $retrieve = mysqli_query($dbc, $query); if(!$retrieve) { die(mysqli_error($query)); } while($row=mysqli_fetch_array($retrieve, mysql_assoc)){ echo "<p style=\"font-color: #ff0000;\">".'<a href="cats.php? catogory='.urldecode($row["name"]).'">'.$row["name"].'</a>'."</p>"; $_session['cat']=$row["name"]; } if(!($_session)) ...
Read more

python - Evaluating the next line in a For Loop while in the current iteration -

here trying do: trying solve issue has wrapping in text file. i want open txt file, read line , if line contains want contain, check next line see if not contain in first line. if not, add line first line. import re stuff = open("my file") line in stuff: if re.search("from ", line): first = line print first if re.search('from ', handle.next()): continue else: first = first + handle.next() else: continue i have looked quite few things , cannot seem find answer. please help! i try this, invalid triples of "from " , not elegant @ all. lines = open("file", 'r').readlines() lines2 = open("file2", 'w') counter_list=[] last_from = 0 counter, line in enumerate(lines): if "from " in line , counter != last_from +1: last_from = counter current_count = counter if current_coun...
Read more