TU Wien:Experiment Design for Data Science VU (Knees)/Exam 26.01.2023

1) Name 5 of the ACM Statement on Algorithmic Transparency and Accountability and explain a) what problem they adress and b) what can be done to solve this problem

2)

• Most prominent advantages of automated algorithms making decision, and why?
• Most prominent disadvantages of automated algorithms making decision, and why?
• What are challenges in making decisions of algorithms transparent?
• What are disadvantages of making algorithms decisions transparent?

3)

• Given an ad-blocker what performance metric is most relevant + formula.
• What statistical tests can be used to measure performance against another system (name two) and explain why they can be used.
• What errors can be made in statistical testing and how can they be reduced

4) Given a dataset of social media texts with timestamps, possible evaluation strategies could be time-based split or cross-validation

• Which one would you choose and why
• What are advantages and disadvantages of the two options