| 1 |
Microsoft Azure Kusto Ingest Library for Python |
| 2 |
=============================================== |
| 3 |
|
| 4 |
.. code-block:: python |
| 5 |
|
| 6 |
from azure.kusto.data import KustoConnectionStringBuilder, DataFormat |
| 7 |
from azure.kusto.ingest import QueuedIngestClient, IngestionProperties, FileDescriptor, BlobDescriptor |
| 8 |
|
| 9 |
ingestion_props = IngestionProperties(database="{database_name}", table="{table_name}", data_format=DataFormat.CSV) |
| 10 |
client = QueuedIngestClient(KustoConnectionStringBuilder.with_interactive_login("https://ingest-{cluster_name}.kusto.windows.net")) |
| 11 |
|
| 12 |
file_descriptor = FileDescriptor("{filename}.csv", 15360) # in this example, the raw (uncompressed) size of the data is 15KB (15360 bytes) |
| 13 |
client.ingest_from_file(file_descriptor, ingestion_properties=ingestion_props) |
| 14 |
client.ingest_from_file("{filename}.csv", ingestion_properties=ingestion_props) |
| 15 |
|
| 16 |
blob_descriptor = BlobDescriptor("https://{path_to_blob}.csv.gz?sas", 51200) # in this example, the raw (uncompressed) size of the data is 50KB (52100 bytes) |
| 17 |
client.ingest_from_blob(blob_descriptor, ingestion_properties=ingestion_props) |
| 18 |
|
| 19 |
|
| 20 |
Overview |
| 21 |
-------- |
| 22 |
|
| 23 |
*Kusto Python Ingest Client* Library provides the capability to ingest data into Kusto clusters using Python. |
| 24 |
It is Python 3.x compatible and supports data types through familiar Python DB API interface. |
| 25 |
|
| 26 |
It's possible to use the library, for instance, from `Jupyter Notebooks <http://jupyter.org/>`_ which are attached to Spark clusters, |
| 27 |
including, but not exclusively, `Azure Databricks <https://azure.microsoft.com/en-us/services/databricks>`_ instances. |
| 28 |
|
| 29 |
* `How to install the package <https://github.com/Azure/azure-kusto-python#install>`_. |
| 30 |
|
| 31 |
* `Data ingest sample <https://github.com/Azure/azure-kusto-python/blob/master/azure-kusto-ingest/tests/sample.py>`_. |
| 32 |
|
| 33 |
* `GitHub Repository <https://github.com/Azure/azure-kusto-python/tree/master/azure-kusto-data>`_. |