Leg HTML-tabellen vast van websites met Python
Er zijn meerdere manieren om HTML-tabellen te converteren into CSV's en Excel-spreadsheets gebruiken GrabzIt's Python API, hier worden enkele van de meest nuttige technieken beschreven. Onthoud echter voordat u begint dat nadat u de URLToTable, HTMLToTable or FileToTable methoden de Save or SaveTo methode moet worden aangeroepen om de tabel vast te leggen. Als u snel wilt zien of deze service geschikt is voor u, kunt u een proberen live demo van het vastleggen van HTML-tabellen van een URL.
Basisopties
Het onderstaande codefragment converteert automatisch de eerste HTML-tabel in een opgegeven webpagina intoa CSV-document dat vervolgens kan worden gedownload of ontleed.
grabzIt.URLToTable("https://www.tesla.com")
# Then call the Save or SaveTo method
grabzIt.HTMLToTable("<html><body><table><tr><th>Name</th><th>Age</th></tr>
<tr><td>Tom</td><td>23</td></tr><tr><td>Nicola</td><td>26</td></tr>
</table></body></html>")
# Then call the Save or SaveTo method
grabzIt.FileToTable("tables.html")
# Then call the Save or SaveTo method
Standaard converteert dit de eerste tabel die wordt geïdentificeerd inteen tafel. De tweede tabel op een webpagina kan echter worden geconverteerd door een 2 door te geven aan de tableNumberToInclude attribuut.
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.tableNumberToInclude = 2
grabzIt.URLToTable("https://www.tesla.com", options)
# Then call the Save or SaveTo method
grabzIt.SaveTo("result.csv")
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.tableNumberToInclude = 2
grabzIt.HTMLToTable("<html><body><table><tr><th>Name</th><th>Age</th></tr>
<tr><td>Tom</td><td>23</td></tr><tr><td>Nicola</td><td>26</td></tr>
</table></body></html>", options)
# Then call the Save or SaveTo method
grabzIt.SaveTo("result.csv")
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.tableNumberToInclude = 2
grabzIt.FileToTable("tables.html", options)
# Then call the Save or SaveTo method
grabzIt.SaveTo("result.csv")
U kunt ook de targetElement kenmerk dat ervoor zorgt dat alleen tabellen binnen het opgegeven element-ID worden geconverteerd.
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.targetElement = "stocks_table"
grabzIt.URLToTable("https://www.tesla.com", options)
# Then call the Save or SaveTo method
grabzIt.SaveTo("result.csv")
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.targetElement = "stocks_table"
grabzIt.HTMLToTable("<html><body><table id='stocks_table'><tr><th>Name</th><th>Age</th></tr>
<tr><td>Tom</td><td>23</td></tr><tr><td>Nicola</td><td>26</td></tr>
</table></body></html>", options)
# Then call the Save or SaveTo method
grabzIt.SaveTo("result.csv")
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.targetElement = "stocks_table"
grabzIt.FileToTable("tables.html", options)
# Then call the Save or SaveTo method
grabzIt.SaveTo("result.csv")
Als alternatief kunt u alle tabellen op een webpagina vastleggen door waar door te geven includeAllTables kenmerk, dit werkt echter alleen met de formaten XLSX en JSON. Met deze optie wordt elke tabel in een nieuw blad in de gegenereerde spreadsheetwerkmap geplaatst.
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.format = 'xlsx'
options.includeAllTables = True
grabzIt.URLToTable("https://www.tesla.com", options)
# Then call the Save or SaveTo method
grabzIt.SaveTo("result.xlsx")
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.format = 'xlsx'
options.includeAllTables = True
grabzIt.HTMLToTable("<html><body><table><tr><th>Name</th><th>Age</th></tr>
<tr><td>Tom</td><td>23</td></tr><tr><td>Nicola</td><td>26</td></tr>
</table></body></html>", options)
# Then call the Save or SaveTo method
grabzIt.SaveTo("result.xlsx")
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.format = 'xlsx'
options.includeAllTables = True
grabzIt.FileToTable("tables.html", options)
# Then call the Save or SaveTo method
grabzIt.SaveTo("result.xlsx")
HTML-tabellen converteren naar JSON
Met behulp van de HTML-tabelconversieservice van Python en GrabzIt kunt u HTML-tabellen converteren into JSON. De eerste stap, zoals hieronder weergegeven, moet worden opgegeven json in de opmaakparameter. We krijgen dan de JSON string synchroon met de SaveTo methode, kunt u vervolgens uw favoriete JSON-parser voor Python gebruiken om de JSON te converteren string intoa object.
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.format = "json"
options.tableNumberToInclude = 1
grabzIt.URLToTable("https://www.tesla.com", options)
json = grabzIt.SaveTo()
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.format = "json"
options.tableNumberToInclude = 1
grabzIt.HTMLToTable("<html><body><table><tr><th>Name</th><th>Age</th></tr>
<tr><td>Tom</td><td>23</td></tr><tr><td>Nicola</td><td>26</td></tr>
</table></body></html>", options)
json = grabzIt.SaveTo()
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.format = "json"
options.tableNumberToInclude = 1
grabzIt.FileToTable("tables.html", options)
json = grabzIt.SaveTo()
Aangepaste identificatie
U kunt een aangepaste identificatie doorgeven aan de tafel methoden zoals hieronder weergegeven, wordt deze waarde vervolgens teruggegeven aan uw GrabzIt Python-handler. Deze aangepaste identificatie kan bijvoorbeeld een database-identificatie zijn, waardoor een screenshot kan worden gekoppeld aan een bepaald database-record.
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.customId = "123456"
grabzIt.URLToTable("https://www.tesla.com", options)
# Then call the Save method
grabzIt.Save("http://www.example.com/handler.py")
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.customId = "123456"
grabzIt.HTMLToTable("<html><body><h1>Hello World!</h1></body></html>", options)
# Then call the Save method
grabzIt.Save("http://www.example.com/handler.py")
from GrabzIt import GrabzItTableOptions
from GrabzIt import GrabzItClient
grabzIt = GrabzItClient.GrabzItClient("Sign in to view your Application Key", "Sign in to view your Application Secret")
options = GrabzItTableOptions.GrabzItTableOptions()
options.customId = "123456"
grabzIt.FileToTable("example.html", options)
# Then call the Save method
grabzIt.Save("http://www.example.com/handler.py")