Signal processing is a rapidly evolving field with many complex problems, ranging from image and speech processing, opinion dynamics, communication systems and vehicular technologies, as well as general sensor data analysis, to name only a few. In order to steer a structured and coherent development and testing of novel signal processing techniques, different tools and approaches can be used. Signal processing challenge is one of these tools and both researchers and practitioners should master it.
1 What is a signal processing challenge?
Signal processing lives from real data collected in trials or experiments. However, rarely we are satisfied with a pure simulative analysis of the data or models. Challenges provide an opportunity to utilize a particular data set as a common standard for a large community of fellow scientists with common objectives: compare and validate different processing techniques, establish common benchmarks, as well as collaborate in the future. Especially in the era of data-driven methods, the design of a common benchmark data set for the challenge is critical for objective comparison of different approaches.
By organizing challenges, researchers and practitioners are encouraged to think creatively and push the boundaries of existing methods and research problems. New algorithms, techniques, or even entirely new approaches can emerge from these challenges, driving the field forward.
2 Why do you want it? (or rather why you do need to organize a challenge)?
Beyond the obvious advantages of method development, the challenges can also be designed as educational activities. They can be structured specifically to allow for an application of knowledge and methodologies in specific application areas, improving participant’s skills and outlook. Challenges can be a valuable learning experience, especially for students and early-career researchers, providing exposure to real-world signal processing problems. Moreover, it helps to build a sense of community not only for a particular problem or task within the challenge, but also within the whole signal processing field.
Whether a challenge is a one-time event, or a repeating competition, it unites people who share a passion for signal processing and solving relevant technical problems, fostering collaboration and advancing science and engineering.
So, how can a signal processing challenge be organized?
3 How to proceed: From an idea to a challenge
So, you decided to organize a challenge. Here is a check list that you need to go through to see if you have all the “ingredients” to make sure it will work out.
3.1 Preparation step
1. Formulate an idea for the challenge
2. Which conference/venue is the most suitable one?
3. Prepare a proposal – don’t forget to check if there is a required template.
3.2 Problem description
1. Motivate the general problem that the challenge aims to solve.
2. Explain the specifics of the challenge focus.
3. Explain how the data was collected.
4. What makes the data unique/or interesting?
3.3 Data set
1. General description/ Manual to the data
2. Small example/Simple testing example to read and visualize the data set
3. Testing portion of the data
4. Validation portion of the data set
3.4 Goals and constraints for participants
1. What are the challenge goals/Proposed problem(s)?
2. Benchmark criterion(s)
3. How results are to be delivered (any code, or just CSV, etc.)?
4. How to avoid cheating/use of AI?
5. Are there any restrictions on methods?
6. Who can participate?
7. Are there any prizes/are they allowed?
3.5 Administration
1. Time schedule
2. Website for the challenge/advertisement in the media and on IEEE ASI/social networks/etc.
3. Personnel for processing the results
4. Legal aspects
4 So, how can we help you?
Venue: We will assist you in finding the perfect conference that will best fit your data-set and challenge focus. This will include inquiries to conference organizers.
Logistics: We will support the organization process and help promote your challenge.
Examples: Upon request we can provide examples of successful challenge submissions.
Template: To ease your challenge submission process, we have prepared a LaTeX template, which we can share with you upon request.
5 Contact us
Have a question? Need help with your challenge proposal? Reach us by email: challenges.asi@gmail.com