Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MultiModal] Cloud Predictor doesn't work for object detection use cases #40

Open
tonyhoo opened this issue Feb 10, 2023 · 0 comments
Open

Comments

@tonyhoo
Copy link
Contributor

tonyhoo commented Feb 10, 2023

If I want to for example adapt the AutoMM Detection - High Performance Finetune on COCO Format Dataset example to MultiModalCloudPredictor, what’s the required train_data format? I tried using the same format as in the local example (train_data="./pothole/pothole/Annotations/usersplit_train_cocoformat.json") but it doesn’t look like that filetype is supported:
ValueError: json file type is not supported.

And for the init and fit args, trying to do something to the effect of:

predictor_init_args = dict(
    hyperparameters={
        "model.mmdet_image.checkpoint_name": checkpoint_name,
        "env.num_gpus": num_gpus,
        "optimization.val_metric": val_metric,
    },
    problem_type="object_detection",
    sample_data_path=train_path,

)

predictor_fit_args = dict(
    train_data=train_path,
    hyperparameters={
        "optimization.learning_rate": 5e-6, # we use two stage and detection head has 100x lr
        "optimization.max_epochs": 1,
        "env.per_gpu_batch_size": 2,  # decrease it when model is large
    },
)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant