Skip to content

Commit 4503aa0

Browse files
author
docs-action
committed
1 parent d2b5b8d commit 4503aa0

File tree

103 files changed

+1503
-132
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

103 files changed

+1503
-132
lines changed

‎404.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -285,7 +285,8 @@
285285
class="nav-list-link">Kubeflow</a></li><li class="nav-list-item "><a href="/integrations/presto_trino.html"
286286
class="nav-list-link">Presto / Trino</a></li><li class="nav-list-item "><a href="/integrations/python.html"
287287
class="nav-list-link">Python</a></li><li class="nav-list-item "><a href="/integrations/r.html"
288-
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
288+
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/unity_catalog.html"
289+
class="nav-list-link">Unity Catalog</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
289290
class="nav-list-link">Vertex AI</a></li></ul></li><li
290291
class="nav-list-item"><a href="#" class="nav-list-expander"><svg viewBox="0 0 24 24">
291292
<use xlink:href="#svg-arrow-right"></use>

‎assets/img/unity_export_hook_result_log.png

29.3 KB
Loading

‎assets/img/unity_exported_table_columns.png

25.2 KB
Loading

‎assets/js/search-data.json

Lines changed: 62 additions & 20 deletions
Large diffs are not rendered by default.

‎howto/catalog_exports.html

Lines changed: 33 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -294,7 +294,8 @@
294294
class="nav-list-link">Kubeflow</a></li><li class="nav-list-item "><a href="/integrations/presto_trino.html"
295295
class="nav-list-link">Presto / Trino</a></li><li class="nav-list-item "><a href="/integrations/python.html"
296296
class="nav-list-link">Python</a></li><li class="nav-list-item "><a href="/integrations/r.html"
297-
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
297+
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/unity_catalog.html"
298+
class="nav-list-link">Unity Catalog</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
298299
class="nav-list-link">Vertex AI</a></li></ul></li><li
299300
class="nav-list-item"><a href="#" class="nav-list-expander"><svg viewBox="0 0 24 24">
300301
<use xlink:href="#svg-arrow-right"></use>
@@ -652,11 +653,37 @@ <h4 id="currently-supported-exporters">
652653
</h4>
653654

654655

655-
<ul>
656-
<li>Symlink Exporter: Writes metadata for the table using Hive’s <a href="https://svn.apache.org/repos/infra/websites/production/hive/content/javadocs/r2.1.1/api/org/apache/hadoop/hive/ql/io/SymlinkTextInputFormat.html">SymlinkTextInputFormat</a></li>
657-
<li>AWS Glue Catalog (+ Athena) Exporter: Creates a table in Glue using Hive’s format and updates the location to symlink files (reuses Symlink Exporter).</li>
658-
<li>See a step by step guide on how to integrate with <a href="/integrations/glue_metastore.html">Glue Exporter</a></li>
659-
</ul>
656+
<div class="table-wrapper"><table>
657+
<thead>
658+
<tr>
659+
<th style="text-align: left">Exporter</th>
660+
<th style="text-align: left">Description</th>
661+
<th style="text-align: left">Notes</th>
662+
</tr>
663+
</thead>
664+
<tbody>
665+
<tr>
666+
<td style="text-align: left"><strong>Symlink exporter</strong></td>
667+
<td style="text-align: left">Writes metadata for the table using Hive’s <a href="https://svn.apache.org/repos/infra/websites/production/hive/content/javadocs/r2.1.1/api/org/apache/hadoop/hive/ql/io/SymlinkTextInputFormat.html">SymlinkTextInputFormat</a></td>
668+
<td style="text-align: left"> </td>
669+
</tr>
670+
<tr>
671+
<td style="text-align: left"><strong>AWS Glue Catalog (+ Athena) exporter</strong></td>
672+
<td style="text-align: left">Creates a table in Glue using Hive’s format and updates the location to symlink files (reuses Symlink Exporter).</td>
673+
<td style="text-align: left">See a step-by-step guide on how to integrate with <a href="/integrations/glue_metastore.html">Glue Exporter</a></td>
674+
</tr>
675+
<tr>
676+
<td style="text-align: left"><strong>Delta Lake table exporter</strong></td>
677+
<td style="text-align: left">Export Delta Lake tables from lakeFS to an external storage</td>
678+
<td style="text-align: left"> </td>
679+
</tr>
680+
<tr>
681+
<td style="text-align: left"><strong>Unity Catalog exporter</strong></td>
682+
<td style="text-align: left">The Unity Catalog exporter serves the purpose of registering a Delta Lake table in Unity Catalog. It operates in conjunction with the Delta Lake exporter. In this workflow, the Delta Lake exporter is utilized to export a Delta Lake table from lakeFS. Subsequently, the obtained result is passed to the Unity Catalog exporter to facilitate its registration within Unity Catalog.</td>
683+
<td style="text-align: left">See a step-by-step guide on how to integrate with <a href="/integrations/unity_catalog.html">Unity Catalog Exporter</a>&lt;/br&gt;Currently, only AWS S3 storage is supported</td>
684+
</tr>
685+
</tbody>
686+
</table></div>
660687
<h4 id="running-an-exporter">
661688

662689

‎howto/copying.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -294,7 +294,8 @@
294294
class="nav-list-link">Kubeflow</a></li><li class="nav-list-item "><a href="/integrations/presto_trino.html"
295295
class="nav-list-link">Presto / Trino</a></li><li class="nav-list-item "><a href="/integrations/python.html"
296296
class="nav-list-link">Python</a></li><li class="nav-list-item "><a href="/integrations/r.html"
297-
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
297+
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/unity_catalog.html"
298+
class="nav-list-link">Unity Catalog</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
298299
class="nav-list-link">Vertex AI</a></li></ul></li><li
299300
class="nav-list-item"><a href="#" class="nav-list-expander"><svg viewBox="0 0 24 24">
300301
<use xlink:href="#svg-arrow-right"></use>

‎howto/deploy/aws.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -294,7 +294,8 @@
294294
class="nav-list-link">Kubeflow</a></li><li class="nav-list-item "><a href="/integrations/presto_trino.html"
295295
class="nav-list-link">Presto / Trino</a></li><li class="nav-list-item "><a href="/integrations/python.html"
296296
class="nav-list-link">Python</a></li><li class="nav-list-item "><a href="/integrations/r.html"
297-
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
297+
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/unity_catalog.html"
298+
class="nav-list-link">Unity Catalog</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
298299
class="nav-list-link">Vertex AI</a></li></ul></li><li
299300
class="nav-list-item"><a href="#" class="nav-list-expander"><svg viewBox="0 0 24 24">
300301
<use xlink:href="#svg-arrow-right"></use>

‎howto/deploy/azure.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -294,7 +294,8 @@
294294
class="nav-list-link">Kubeflow</a></li><li class="nav-list-item "><a href="/integrations/presto_trino.html"
295295
class="nav-list-link">Presto / Trino</a></li><li class="nav-list-item "><a href="/integrations/python.html"
296296
class="nav-list-link">Python</a></li><li class="nav-list-item "><a href="/integrations/r.html"
297-
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
297+
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/unity_catalog.html"
298+
class="nav-list-link">Unity Catalog</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
298299
class="nav-list-link">Vertex AI</a></li></ul></li><li
299300
class="nav-list-item"><a href="#" class="nav-list-expander"><svg viewBox="0 0 24 24">
300301
<use xlink:href="#svg-arrow-right"></use>

‎howto/deploy/gcp.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -294,7 +294,8 @@
294294
class="nav-list-link">Kubeflow</a></li><li class="nav-list-item "><a href="/integrations/presto_trino.html"
295295
class="nav-list-link">Presto / Trino</a></li><li class="nav-list-item "><a href="/integrations/python.html"
296296
class="nav-list-link">Python</a></li><li class="nav-list-item "><a href="/integrations/r.html"
297-
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
297+
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/unity_catalog.html"
298+
class="nav-list-link">Unity Catalog</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
298299
class="nav-list-link">Vertex AI</a></li></ul></li><li
299300
class="nav-list-item"><a href="#" class="nav-list-expander"><svg viewBox="0 0 24 24">
300301
<use xlink:href="#svg-arrow-right"></use>

‎howto/deploy/index.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -294,7 +294,8 @@
294294
class="nav-list-link">Kubeflow</a></li><li class="nav-list-item "><a href="/integrations/presto_trino.html"
295295
class="nav-list-link">Presto / Trino</a></li><li class="nav-list-item "><a href="/integrations/python.html"
296296
class="nav-list-link">Python</a></li><li class="nav-list-item "><a href="/integrations/r.html"
297-
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
297+
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/unity_catalog.html"
298+
class="nav-list-link">Unity Catalog</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
298299
class="nav-list-link">Vertex AI</a></li></ul></li><li
299300
class="nav-list-item"><a href="#" class="nav-list-expander"><svg viewBox="0 0 24 24">
300301
<use xlink:href="#svg-arrow-right"></use>

‎howto/deploy/onprem.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -294,7 +294,8 @@
294294
class="nav-list-link">Kubeflow</a></li><li class="nav-list-item "><a href="/integrations/presto_trino.html"
295295
class="nav-list-link">Presto / Trino</a></li><li class="nav-list-item "><a href="/integrations/python.html"
296296
class="nav-list-link">Python</a></li><li class="nav-list-item "><a href="/integrations/r.html"
297-
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
297+
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/unity_catalog.html"
298+
class="nav-list-link">Unity Catalog</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
298299
class="nav-list-link">Vertex AI</a></li></ul></li><li
299300
class="nav-list-item"><a href="#" class="nav-list-expander"><svg viewBox="0 0 24 24">
300301
<use xlink:href="#svg-arrow-right"></use>

‎howto/deploy/upgrade.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -294,7 +294,8 @@
294294
class="nav-list-link">Kubeflow</a></li><li class="nav-list-item "><a href="/integrations/presto_trino.html"
295295
class="nav-list-link">Presto / Trino</a></li><li class="nav-list-item "><a href="/integrations/python.html"
296296
class="nav-list-link">Python</a></li><li class="nav-list-item "><a href="/integrations/r.html"
297-
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
297+
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/unity_catalog.html"
298+
class="nav-list-link">Unity Catalog</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
298299
class="nav-list-link">Vertex AI</a></li></ul></li><li
299300
class="nav-list-item"><a href="#" class="nav-list-expander"><svg viewBox="0 0 24 24">
300301
<use xlink:href="#svg-arrow-right"></use>

‎howto/export.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -294,7 +294,8 @@
294294
class="nav-list-link">Kubeflow</a></li><li class="nav-list-item "><a href="/integrations/presto_trino.html"
295295
class="nav-list-link">Presto / Trino</a></li><li class="nav-list-item "><a href="/integrations/python.html"
296296
class="nav-list-link">Python</a></li><li class="nav-list-item "><a href="/integrations/r.html"
297-
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
297+
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/unity_catalog.html"
298+
class="nav-list-link">Unity Catalog</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
298299
class="nav-list-link">Vertex AI</a></li></ul></li><li
299300
class="nav-list-item"><a href="#" class="nav-list-expander"><svg viewBox="0 0 24 24">
300301
<use xlink:href="#svg-arrow-right"></use>

‎howto/garbage-collection/gc.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -294,7 +294,8 @@
294294
class="nav-list-link">Kubeflow</a></li><li class="nav-list-item "><a href="/integrations/presto_trino.html"
295295
class="nav-list-link">Presto / Trino</a></li><li class="nav-list-item "><a href="/integrations/python.html"
296296
class="nav-list-link">Python</a></li><li class="nav-list-item "><a href="/integrations/r.html"
297-
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
297+
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/unity_catalog.html"
298+
class="nav-list-link">Unity Catalog</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
298299
class="nav-list-link">Vertex AI</a></li></ul></li><li
299300
class="nav-list-item"><a href="#" class="nav-list-expander"><svg viewBox="0 0 24 24">
300301
<use xlink:href="#svg-arrow-right"></use>

‎howto/garbage-collection/managed-gc.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -294,7 +294,8 @@
294294
class="nav-list-link">Kubeflow</a></li><li class="nav-list-item "><a href="/integrations/presto_trino.html"
295295
class="nav-list-link">Presto / Trino</a></li><li class="nav-list-item "><a href="/integrations/python.html"
296296
class="nav-list-link">Python</a></li><li class="nav-list-item "><a href="/integrations/r.html"
297-
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
297+
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/unity_catalog.html"
298+
class="nav-list-link">Unity Catalog</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
298299
class="nav-list-link">Vertex AI</a></li></ul></li><li
299300
class="nav-list-item"><a href="#" class="nav-list-expander"><svg viewBox="0 0 24 24">
300301
<use xlink:href="#svg-arrow-right"></use>

‎howto/hooks/airflow.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -294,7 +294,8 @@
294294
class="nav-list-link">Kubeflow</a></li><li class="nav-list-item "><a href="/integrations/presto_trino.html"
295295
class="nav-list-link">Presto / Trino</a></li><li class="nav-list-item "><a href="/integrations/python.html"
296296
class="nav-list-link">Python</a></li><li class="nav-list-item "><a href="/integrations/r.html"
297-
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
297+
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/unity_catalog.html"
298+
class="nav-list-link">Unity Catalog</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
298299
class="nav-list-link">Vertex AI</a></li></ul></li><li
299300
class="nav-list-item"><a href="#" class="nav-list-expander"><svg viewBox="0 0 24 24">
300301
<use xlink:href="#svg-arrow-right"></use>

‎howto/hooks/index.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -294,7 +294,8 @@
294294
class="nav-list-link">Kubeflow</a></li><li class="nav-list-item "><a href="/integrations/presto_trino.html"
295295
class="nav-list-link">Presto / Trino</a></li><li class="nav-list-item "><a href="/integrations/python.html"
296296
class="nav-list-link">Python</a></li><li class="nav-list-item "><a href="/integrations/r.html"
297-
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
297+
class="nav-list-link">R</a></li><li class="nav-list-item "><a href="/integrations/unity_catalog.html"
298+
class="nav-list-link">Unity Catalog</a></li><li class="nav-list-item "><a href="/integrations/vertex_ai.html"
298299
class="nav-list-link">Vertex AI</a></li></ul></li><li
299300
class="nav-list-item"><a href="#" class="nav-list-expander"><svg viewBox="0 0 24 24">
300301
<use xlink:href="#svg-arrow-right"></use>

0 commit comments

Comments
 (0)