COP290 Lab1 Autograder

Play demo

1. Install asciinema
2. Run asciinema play autograder.cast

Prerequisite

1. Ubuntu
2. Python3.12 (Might work on 3.10, 3.11 as well, haven't tested though)
3. gcc-11 to compile your project
4. Project zip that you submitted on the moodle

First time setup

1. git clone https://github.com/satyamjay-iitd/cop290_autograder
2. cd lab1_autograder
3. Create python virtualenv:- python3.12 -m venv venv
4. Activate environment:- source venv/bin/activate
5. Install dependencies:- pip install -r requirements.txt

Two types of testers:-

main.py

main.py: uses pexpect and is ideal for small testcases. Test cases tested using this tester is located here:- hidden_tc/

Run all tests in a directory

python main.py single {path_to_zip_file} hidden_tc/ marks_mapping.csv

Run single test

python main.py single {path_to_zip_file} hidden_tc/*/*.cmds marks_mapping.csv

main2.py

main2.py: parses just the final output and checks total runtime and memory. It is used for test cases with lot of commands (> 1000). Test cases tested using this tester is located here:- hidden_tc2/

Run all tests in a directory

python main2.py single {path_to_zip_file} hidden_tc2/ marks_mapping.csv

Run single test

python main2.py single {path_to_zip_file} hidden_tc2/*/*.cmds marks_mapping.csv