Skip to content

Commit

Permalink
docs(datasets) Add info about dataset availability to FDS docs (#3902)
Browse files Browse the repository at this point in the history
  • Loading branch information
adam-narozniak authored Jul 25, 2024
1 parent 7e4adf6 commit 42f5c8d
Showing 1 changed file with 8 additions and 4 deletions.
12 changes: 8 additions & 4 deletions datasets/doc/source/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -67,10 +67,14 @@ Main features
-------------
Flower Datasets library supports:

- **downloading datasets** - choose the dataset from Hugging Face's ``dataset`` (`link <https://huggingface.co/datasets>`_)
- **partitioning datasets** - choose one of the implemented partitioning scheme or create your own.
- **creating centralized datasets** - leave parts of the dataset unpartitioned (e.g. for centralized evaluation)
- **visualization of the partitioned datasets** - visualize the label distribution of the partitioned dataset (and compare the results on different parameters of the same partitioning schemes, different datasets, different partitioning schemes, or any mix of them)
- **Downloading datasets** - choose the dataset from Hugging Face's ``dataset`` (`link <https://huggingface.co/datasets>`_)(*)
- **Partitioning datasets** - choose one of the implemented partitioning scheme or create your own.
- **Creating centralized datasets** - leave parts of the dataset unpartitioned (e.g. for centralized evaluation)
- **Visualization of the partitioned datasets** - visualize the label distribution of the partitioned dataset (and compare the results on different parameters of the same partitioning schemes, different datasets, different partitioning schemes, or any mix of them)

.. note::

(*) Once the dataset is available on HuggingFace Hub it can be **immediately** used in ``Flower Datasets`` (no approval from the Flower team needed, no custom code needed).


.. image:: ./_static/readme/comparison_of_partitioning_schemes.png
Expand Down

0 comments on commit 42f5c8d

Please sign in to comment.