|
1 | 1 | ### TFX OSS roadmap
|
2 |
| -This highlights the main OSS efforts for the TFX team in Q4 2020 and Q1 2021, |
3 |
| -along with the history from 2019 onwards. If you're interested in contributing |
4 |
| -in one of these areas, |
| 2 | +This highlights the main OSS efforts for the TFX team, along with the history. |
| 3 | +If you're interested in contributing in one of these areas, |
5 | 4 | [contributions](https://github.com/tensorflow/tfx/blob/master/CONTRIBUTING.md)
|
6 | 5 | are always welcome, especially in areas that extend TFX into infrastructure
|
7 | 6 | currently not widely in use at Google.
|
@@ -35,57 +34,39 @@ in production.
|
35 | 34 | [Kubeflow](https://www.kubeflow.org/), and
|
36 | 35 | [TensorFlow 2.0](https://www.tensorflow.org/versions/r2.0/api_docs/).
|
37 | 36 | * Make TFX more ML framework neutral to enable wider usage.
|
38 |
| -* Encourage the discovery and reuse of external contributions. |
39 |
| -* Extend portability across additional cluster computing frameworks (e.g. |
40 |
| -[Kubernetes](https://kubernetes.io/), [Apache Flink](https://flink.apache.org/) |
41 |
| -and data formats (e.g. [Apache Avro](https://avro.apache.org/), |
42 |
| -[Apache Parquet](https://parquet.apache.org/)). |
| 37 | +* Encourage the discovery and reuse of external contributions, TFX-Addons. |
| 38 | +* Extend portability across additional cluster computing frameworks. |
43 | 39 |
|
44 | 40 | ##### Usability
|
45 |
| -* Support more distributed strategies in TensorFlow 2.x. |
46 | 41 | * Improving the testing capabilities for OSS developers.
|
47 |
| -* Reach feature parity and make it easy to move ML focused pipelines from |
48 |
| - Kubeflow pipelines (KFP) to TFX DSL. Also share the same pipeline |
49 |
| - intermediate representation for both platforms to guarantee semantics and |
50 |
| - data model consistency. |
51 |
| -* Support loading KFP components (defined in YAML) in TFX pipelines. |
52 |
| -* Support for training on continuously arriving data and more advanced |
53 |
| - orchestration semantics. |
| 42 | +* Support for more advanced orchestration semantics. |
54 | 43 | * Create examples and templates for more ML verticals.
|
55 | 44 |
|
56 | 45 | ##### Performance
|
57 |
| -* Better distributed training support |
58 |
| -([DistributionStrategy](https://www.tensorflow.org/guide/distribute_strategy)). |
| 46 | +* Better TPU support on Cloud. |
59 | 47 | * Support for more performant file storage formats than TFRecords.
|
60 | 48 | * Better telemetry for users to understand the behavior of components in a
|
61 |
| -TFX pipeline. |
62 |
| - |
63 |
| -##### Education |
64 |
| -* Work with [ML Metadata](https://www.tensorflow.org/tfx/guide/mlmd) to |
65 |
| - publish standard ontology types and showcase them through TFX. |
| 49 | + TFX pipeline. |
66 | 50 |
|
67 | 51 | ##### Innovation and collaboration
|
68 |
| -* Further enhance integration with [tf.Lite](https://www.tensorflow.org/lite/) |
69 |
| -to better support mobile, IoT, and edge devices. |
70 | 52 | * Formalize Special Interest Groups (SIGs) for specific aspects of TFX to
|
71 |
| -accelerate community innovation and collaboration. |
| 53 | + accelerate community innovation and collaboration. |
72 | 54 | * Early access to new features.
|
73 | 55 |
|
74 | 56 | #### History
|
75 | 57 |
|
76 | 58 | [Towards ML Engineering: A Brief History Of TensorFlow Extended (TFX)](https://blog.tensorflow.org/2020/09/brief-history-of-tensorflow-extended-tfx.html)
|
77 |
| -* Q3 2020 * Component Launches & Enhancements * Cloud AI Platform integration |
78 |
| -with BulkInferrer * Multi Framework Support in TFX Components * Experimental |
79 |
| -[Scikit Learn example in TFX](https://github.com/tensorflow/tfx/blob/master/tfx/examples/penguin/experimental/penguin_utils_sklearn.py) |
80 |
| -* On Device * Support for TFJS in Evaluator component * Orchestration: * |
81 |
| -[(RFC) Asynchronous / data driven pipelines](https://github.com/tensorflow/community/blob/master/rfcs/20200601-tfx-udsl-semantics.md) |
82 |
| -* Intermediate Representation (IR) * Object detection example - |
83 |
| -[CIFAR-10](https://github.com/tensorflow/tfx/tree/master/tfx/examples/cifar10) * |
84 |
| -NLP Bert examples |
85 |
| -[CoLA](https://github.com/tensorflow/tfx/tree/master/tfx/examples/bert/cola), |
86 |
| -and [MRPC](https://github.com/tensorflow/tfx/tree/master/tfx/examples/bert/mrpc) |
87 |
| -* Supported custom splits for ExampleGen's downstream components. |
88 | 59 |
|
| 60 | +* Q2 2022 |
| 61 | + * Dynamic Exec Properties support for Vertex. |
| 62 | + * Vertex Machine type configuration. |
| 63 | + * Investige other splitable file storage formats than just TFRecord. |
| 64 | +* Q3 2020 |
| 65 | + * Component Launches & Enhancements. |
| 66 | + * Cloud AI Platform integration with BulkInferrer. |
| 67 | + * Multi Framework Support in TFX Components. |
| 68 | + * On Device Support for TFJS in Evaluator component. |
| 69 | + * Intermediate Representation (IR). |
89 | 70 | * Q2 2020
|
90 | 71 | * Custom component authoring was made easier by supporting python function
|
91 | 72 | and custom container.
|
|
0 commit comments