Welcome to the Deakin Simpsons Challenge 2022

The Deakin Simpsons challenge 2022 is a computer vision competition for which the goal is:

Given an image of Simpsons and a natural language question about the image, the task is to provide an accurate natural language answer using machine learning and deep learning.

The challenge is designed to provide students with the opportunity to work as team members, to compete with each other, and to enhance the student learning experience by improving their AI modeling, problem-solving, and team-working skills.

Table of Contents

1. About the task
2. Winners
3. Timeline
4. Eligibility
5. Prizes and Sponsors
6. Benefit
7. Participate
8. Webinar
9. Questions
10. References
11. Acknowledgment

About the task

As participants, your goal is to build a machine learning/deep learning model to answer a natural language Yes/No question given an image of Simpsons.

Once you have built your model, you will have to submit it on the CodaLab platform to be evaluated. We evaluate the performance of your model using the Accuracy on a private test set that we have directly collected and labeled from TV show episodes. Once the evaluation completed, your entry will appear on the leaderboard to see your performance against other competitors.

In the Notebook that we provide for starting, we will take you through a 6-step process to build a simple model to perform this task as follows:

1. Setup the environment: Thie first step consists of setting the environement and downloading the data.
2. Preprocessing: The second step is a preprocessing step that consists of resizing, plitting, and piping the input data.
3. Exploring the data: The third step consists of a simple data exploration step where you will see samples of the data and some statistics to help you in understanding the data.
4. Designing the model: The forth step consists of designing an architecture for the task.
5. Traning: The fifth step consists of starting the training process.
6. Monitoring: The sixth step consists of monitoring the traning process to investigate possible overfitting.
7. Submitting: The seventh and last step will take you through the submission process.

Winners

The winners of the competition are:

1. Jess (Accuracy = 70.40) [report][code] 🥇
2. peterja555 (Accuracy = 56.40) [report] [code] 🥈
3. Bugs (Accuracy = 55.20) [report] [code] 🥉
4. Xiaolumang (Accuracy = 54.00) [report] [code] 🎁
5. Gavinnf (Accuracy = 50.40) [report] [code] 🎁

Timeline

• 30.03.22: Contest and Phase 1 Begin (Validation Leaderboard opens).
• 30.03.22: Join the Webinar at 6:00 PM to review procedures and for a live Q&A session.
• 15.05.2224.07.22: Phase 2 Begin (Testing Leaderboard opens) 🚨 ONLY TWO SUBMISSIONS ARE ALLOWED FOR THE TEST PHASE! PLEASE MAKE SURE TO SUBMIT YOUR BEST MODEL FROM PHASE 1! 🚨.
• 22.05.22 31.07.22: Last Shot & Contest End (Testing Leaderboard closes).
• 23.05.22 01.08.22: Semi-Finalists Announcement (top six teams on the Testing Leaderboard).
• 05.06.22 14.08.22: Report & Code Due.
• 17.06.22 26.08.22: Winners Announcement.

Eligibility

The competition is open to all Deakin's students. Also, in order to be eligible for any award, the semi-finalists are required to:

• 🚨 Submit your model to the test leaderboard.
• 🚨 Submit a report, which describes the solution by the stipulated deadline (4 pages maximum, using the Master Article Template – LaTeX, with the “sigconf” option). Please use the following easychair link to submit your report. The reports will eventually be made publicly available on the website.
• 🚨 Provide a link of the Github repo of the solution in the report. The submitted codes and reports may be inspected to check the validity of the solution.

Prizes and Sponsors

The winners of the Deakin Simpsons Challenge 2022 await non-cash prizes worth 🏆AUD3,000🏆 funded by Community Bank at Deakin University.

The prizes will be distributed among the participants as follows:

• 🥇 The 1st Place receives a non-cash prize equivalent of 🏆AUD1,400🏆.
• 🥈 The 2nd Place receives a non-cash prize equivalent of AUD400.
• 🥉 The 3rd Place receives a non-cash prize equivalent of AUD400.
• 🎁 The 4th Place will also receive a non-cash prize equivalent of AUD400.
• 🎁 The 5th Place will also receive a non-cash prize equivalent of AUD400.

Why should you participate?

Often, students work theoretically and experiment with data themselves. They rarely get the chance to practice before working with data in the real-world. With this competition, you have the opportunity to interact and compete in solving real-life problems.

This competition serves many purposes:

• First, it is the perfect place to learn best practices in AI, accrue feedback on your work, and augment your skills.
• Second, it is a channel for problem-solving and brainstorming by probing the multitude of crowdsourced solutions to a problem.
• Third, this competition is an opportunity to push boundaries and encourage creativity among the best and the brightest in AI.
• Fourth, the experience you get is invaluable in preparing you to understand what goes into finding feasible solutions for big data.
• Finally, in addition to the non-cash award that you will gain if you are on the podium (among the three winners), the school official award that will be given to you provides an invaluable recognition for the challenging work you will have achieved. In particular, the award can raise your credibility as a PhD scholarship applicant or as a job seeker because your application will be viewed differently compared to other applicants and, as a result, you will be in a better position to receive more scholarship offers or job offers.

Are you competitive enough to participate?

Follow these steps:

1. Register to the CodaLab platform, then register to the competition on CodaLab.
2. You can participate individually or in a team. There cannot be more than 3 students in a team (all team members need to register to the competition).
3. To find team members, you can post a message on the discussion forum on CodaLab. Once you have built your team, the team leader needs to contact Mohamed Reda Bouadjenek with the names of the members, their CodaLab usernames, the Deakin course in which they are enrolled, and the name of the team.
4. Please fork this GitHub repository and make it private. Then, click here to open the Notebook in Google Colab .
5. If needed, we can provide you with paid Google Cloud resources to train your model (which includes a large amount of GPU resources). However, you need to make a first submission and demonstrate your commitment to the challenge.

8. Just follow the instructions!

We wish you all the best!

Deakin Simpsons Challenge 2022 Webinar

JOIN the Deakin Simpsons Challenge 2022 Webinar on Wednesday, March 30th at 6:00PM. This webinar will review procedures and tips for participating and offer a live Q&A session with the challenge organizers and AI experts.

Please register for the Webinar here!

Link to the Webinar recording!

Questions?

• Please first go through all the pages in this competition for complete information.
• If you have further questions, please post them on the Forum tab.
• Alternatively, you can contact Mohamed Reda Bouadjenek.

References

• VQA: Visual Question Ansewering.
• VQA: Visual Question Answering (ICCV 2015).

Acknowledgment

The Deakin Simpsons Challenge 2022 is organized by the School of Information Technology, Faculty of Sci Eng & Built Env (SEBE) at Deakin University.

The following people are involved:

• Mohamed Reda Bouadjenek - Organization, technical design, development, and data preparation.
• Sunil Aryal - technical design, and support to students.
• Rita Wu - organization and support.
• Jesse Mcmeikan - organization.
• Ngoc Dung Huynh - data labeling and support to students.
• Muhammad Zeeshan Khan - data labeling and support to students.
• Vinayaka Vivekananda Malgi - data labeling and support to students.

School of Information Technology, Faculty of Sci Eng & Built Env

Deakin University

Locked Bag 20000, Geelong, VIC 3220

www.deakin.edu.au