04 Assignment Submission Guide

Before you can use the web submission, you have to register to the website:

1. Visit: https://cs4246.comp.nus.edu.sg/signup/
2. Fill up the details accordingly, with Student ID being AXXXXXXXX and associated [email protected] email id.
3. Follow the requirement for the password, and press submit to register

Important: we will manually accept registration, please register early and avoid registering just before the deadline since it might not be processed in time.

Login

After your account request is accepted, you can log in here: https://cs4246.comp.nus.edu.sg/accounts/login/.

Submission

To make a submission, visit the course page (after you are logged in), click on the task that you want to submit, and upload your agent file (as a zipped file).

Your zipped file will look like this:

setup.py
agent/
    __init__.py
    ...
...

And your __init__.py will have to at least contain function create_agent(test_case_id) which will return the agent with the specified test_case_id.

It might be useful for you to read our FAQ before proceeding with your submission: Frequently Asked Questions.

Interpreting Result

Note the following points regarding interpreting the evaluation in aiVLE.

1. The evaluation result indicates the reward received by the agent for each step and the cumulative reward.
2. To pass the test case, just green tick is not enough. You need to get the reward of 10 for each test case, which is received upon reaching the goal state.
3. The Verdict shows the number of test cases passed. For Homework 1, the verdict is also the points gained. Both part (a) and (b) have 3 test cases for 1 point each.

Important:

1. There will be some delay before your submission will get processed depending on the number of queues. Hence, make sure that your submission runs locally before submitting.
2. There will be a limit of some submissions a day (depending on the task), use it wisely.