Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support multiple annotators on the same image #2

Open
Ownmarc opened this issue Mar 9, 2020 · 1 comment
Open

Support multiple annotators on the same image #2

Ownmarc opened this issue Mar 9, 2020 · 1 comment

Comments

@Ownmarc
Copy link

Ownmarc commented Mar 9, 2020

I work mostly with images and this is something missing in most tools/annotations format.

Basic example where there is annotations propositions from 2 annotators, 2 from auto-labeling strategies (active learning) and 1 that would have been accepted as "ground_truth" by a reviser or someone with the right to "accept" a ground truth annotation :

{
  "filename": "12345.jpg",
  "key": "12345",
  "size": {
    "width": 4608,
    "height": 2240,
    "depth": 3
  },
  "annotations": {
    "ground_truth": {
      "objects": [
        {
          "name": "cat",
          "bndbox": {
            "left": 600,
            "top": 100,
            "right": 2000,
            "bottom": 1000
          },
          "size": {
            "width": 1400,
            "height": 900,
            "depth": 3
          }
        },
        {
          "name": "dog",
          "bndbox": {
            "left": 2200,
            "top": 500,
            "right": 4100,
            "bottom": 2000
          },
          "size": {
            "width": 1900,
            "height": 1500,
            "depth": 3
          }
        }
      ]
    },
    "Annotator A": {
      "objects": [
        {
          "name": "cat",
          "bndbox": {
            "left": 2300,
            "top": 600,
            "right": 4000,
            "bottom": 1600
          },
          "last_modified": 1571155991.1324713,
          "size": {
            "width": 1700,
            "height": 1000,
            "depth": 3
          }
        }
      ]
    },
    "Annotator B": {
      "objects": [
        {
          "name": "cat",
          "bndbox": {
            "left": 2300,
            "top": 600,
            "right": 4000,
            "bottom": 1600
          },
          "last_modified": 1571155991.1324713,
          "size": {
            "width": 1700,
            "height": 1000,
            "depth": 3
          }
        }
      ]
    },
    "Yolo model": {
      "objects": [
        {
          "name": "cat",
          "bndbox": {
            "left": 2300,
            "top": 600,
            "right": 4000,
            "bottom": 1600
          },
          "last_modified": 1571155991.1324713,
          "size": {
            "width": 1700,
            "height": 1000,
            "depth": 3
          }
        }
      ]
    },
    "SSD model": {
      "objects": [
        {
          "name": "cat",
          "bndbox": {
            "left": 2300,
            "top": 600,
            "right": 4000,
            "bottom": 1600
          },
          "last_modified": 1571155991.1324713,
          "size": {
            "width": 1700,
            "height": 1000,
            "depth": 3
          }
        }
      ]
    }
  }
}
@seveibar
Copy link
Contributor

seveibar commented Mar 9, 2020

Thanks for the information about your use case @Ownmarc . Any large dataset will need quality control/user management to make sure data is being completed well with good oversight.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants