Fairness In Algorithmic Peocessing Flashcards

1
Q

Scenario: An employer modifies a model to prevent gender bias in the selection of candidates for an interview. As a result, a man with qualifications similar to women candidates is not invited to an interview. The man complains.

Back:
Question: Should the employer continue to interview the women candidates, or adjust its model again to ensure that any ‘more qualified’ men get interviews instead?

A

This scenario presents a conflict between group fairness and individual fairness.

The employer may need to adjust the model again to ensure that it promotes both group and individual fairness.

consider the specific context of the situation and the potential impact of any decision on fairness.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Flashcard #9:
Question: What is the difference between formal equality and substantive equality?

A

Formal equality refers to treating everyone the same, regardless of any differences or historical disadvantages they may have faced, while substantive equality recognizes and addresses these differences in order to achieve equal outcomes.

Example: A formal equality approach to education would involve providing the same resources and opportunities to all students, regardless of their background or individual needs, while a substantive equality approach would involve providing additional resources and support to students who have historically faced disadvantages, such as students from low-income families or students with disabilities, in order to ensure they have an equal opportunity to succeed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Flashcard #10:
Question: What is luck egalitarianism?

A

Answer: Luck egalitarianism is the principle that all inequalities that result from factors beyond an individual’s control, such as being born into a disadvantaged family or with a disability, should be corrected to promote fairness.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Flashcard #11:
Question: What is the goal of fair recognition in ADM?

A

Answer: The goal of fair recognition is to ensure adequate representation of different cultural identities and prevent misrecognition, which can violate people’s identities and prevent them from participating on equal terms in social interactions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Question: What is the difference between individual fairness and group fairness?

A

Answer: Individual fairness seeks to

  • treat similar individuals equally, regardless of their group membership, while
  • group fairness seeks to ensure parity across protected groups for each outcome class.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Flashcard #13:
Question: What is the “egalitarian plateau” in ADM?

A

Answer: The “egalitarian plateau” refers to the point at which increasing group fairness can lead to decreased individual fairness, and vice versa.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Flashcard #14:
Question: What is the responsibility of a fair ADM system with regard to inequalities resulting from personal choices?

A

Answer: A fair ADM system should allow for inequalities resulting from individuals’ free choice and informed risk taking, but correct inequalities that do not stem from personal choices, such as those resulting from being born into a disadvantaged family or with a disability.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Flashcard #15:
Question: What is the importance of recognizing one’s worldview in debates about fairness in ADM?

A

Answer: Recognizing one’s worldview is important because it allows for transparency and enables others to contest one’s assumptions and biases.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Front: What is individual fairness?

A

Back: Individual fairness is the principle that for any two individuals, if their distance in a task-relevant similarity (e.g. qualifications) is sufficiently small, they should receive the same outcome. This means that similar individuals should be treated equally.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Front: What is group fairness?

A

Back: Group fairness is the principle that an outcome is fair if there is some kind of parity across protected groups for each outcome class. There are different measures for group fairness, but the idea is to avoid or correct some forms of inequalities across groups.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Front: What is the “egalitarian plateau” in ADM?

A

Back: The “egalitarian plateau” refers to the tension between individual and group fairness in algorithmic decision making (ADM). While both types of fairness seek to operationalize certain conceptions of equality, they can sometimes conflict with each other.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Front: What is formal equality?

A

Back: Formal equality is the principle that likes should be treated alike, meaning that everyone should be treated equally under the law or in a given situation regardless of their personal characteristics. This concept is also known as “equal treatment” and is a type of individual fairness.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Front: What is substantive equality?

A

Back: Substantive equality is the principle that individuals should be treated equally in a broader sense, beyond formal equality. This means that efforts should be made to level the playing field for people who face structural disadvantages or systemic discrimination. This is often associated with group fairness.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Front: What is luck egalitarianism?

A

Back: Luck egalitarianism is a philosophical theory that holds that all inequalities that do not stem from individuals’ voluntary choices but from mere brute luck, either social or natural, should be corrected. This means that people who are worse off due to factors outside of their control, such as being born with a disability or into a disadvantaged family, should be entitled to compensation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Front: What is formal equality of opportunity?

A

Back: Formal equality of opportunity is the principle that individuals should be judged only by attributes relevant to the performance of tasks required by a position. This means that attributes such as race or gender should not be taken into account. This concept is also known as “meritocratic equality of opportunity” and is a type of individual fairness.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Front: What is substantive equality of opportunity?

A

Back: Substantive equality of opportunity is the principle that society should do what it can to level the playing field among individuals who compete for positions, particularly through their developmental years. This means that efforts should be made to provide and correct comparable developmental opportunities for people who face structural disadvantages or systemic discrimination. This is often associated with group fairness.

17
Q

Front: What is fairness through unawareness?

A

Back: Fairness through unawareness is a technique for achieving formal equality of opportunity by not taking certain personal characteristics into account when making decisions. The idea is that nothing other than an individual’s talents should affect their life prospects.

18
Q

Front: What is meritocracy?

A

Back: Meritocracy is a system in which positions and goods are distributed only according to individual merit. This means that opportunities to develop merit are not distributed equally and can lead to unequal outcomes.

19
Q

Front: What is the difference between formal and substantive equality of opportunity?

A

Back: Formal equality of opportunity focuses on treating individuals equally under the law or in a given situation, while substantive equality of opportunity seeks to level the playing field for people who face structural disadvantages or systemic discrimination. Formal equality of opportunity is a type of individual fairness, while substantive equality of opportunity is often associated with group fairness.

20
Q

Front:
Topic: Accountable algorithms and democratic processes
Question: What is the difference between attributability and accountability in terms of algorithmic decision making?
Answer: Attributability is concerned with whether an agent is blameworthy for an outcome, while accountability is concerned with the agent’s obligations to address the outcome.

A
21
Q

Front:
Topic: Democratic processes
Question: What are the requirements for democratic decision-making processes?

A

Answer: Democratic decision-making processes require effective participation, understanding of the issues involved, and control over the final agenda. Without these requirements, decisions made are considered illegitimate.

22
Q

Front:
Topic: Top-down and bottom-up approaches to algorithmic justice
Question: What are the top-down and bottom-up approaches to algorithmic justice?

A

Answer: The top-down approach involves collective responsibility and regulation of algorithmic decision-making processes, while the bottom-up approach involves public deliberation, evaluation of models, and collective decision-making.

23
Q

Front:
Topic: Hybrids for accountable algorithms
Question: What are some examples of hybrids for accountable algorithms?

A
  • Model cards provide standardized documentation for machine learning models.
  • Fairness dashboards offer visualization tools for assessing algorithmic fairness.
  • Human-in-the-loop systems allow for human oversight and intervention in automated decision-making processes.
24
Q

Front:
Topic: Folk requirements for responsibility
Question: What are the folk requirements for responsibility?

A

Answer: The folk requirements for responsibility include awareness and control, with awareness implying that individuals should be aware of relevant information to mitigate implicit bias and control implying that agents may intervene to redirect the influence of implicit bias.

25
Q

Front:
Topic: Collective responsibility
Question: What is collective responsibility in the context of algorithmic decision making?
.

A

Answer: Collective responsibility in algorithmic decision making involves the obligation to address patterns of unfair outcomes caused by structural discrimination, with responsibility proportional to power for harm/change

26
Q

Front:
Topic: Turn the tables
Question: What is meant by “turn the tables” in the context of algorithmic decision making?

A

Answer: “Turn the tables” involves creating situations where individuals who are usually marginalized or underrepresented have the power to question, challenge, and change the system.

27
Q

Front:
Topic: Democratic equality
Question: What is democratic equality?

A

Answer: Democratic equality refers to relationships of equality established by democracy, where citizens share equal authority over what they do together and respect one another as equals.

28
Q

Front:
Topic: Public deliberation
Question: What is public deliberation?

A

Answer: Public deliberation involves ex-ante and ex-post public conversation, evaluation of models by socially salient groups, public contestation, public deliberation, and collective decisions.

29
Q

Front:
Topic: Ethical infrastructure
Question: What is meant by “ethical infrastructure” in the context of algorithmic decision making?

A

Answer: Ethical infrastructure involves creating policies, procedures, and practices that encourage ethical decision-making and incorporate values such as fairness, accountability, transparency, and diversity.

30
Q

Front:
Topic: Bottom-up approach
Question: What is the bottom-up approach to algorithmic justice?

A

Answer: The bottom-up approach involves public deliberation, evaluation of models by socially salient groups, public contestation, public deliberation, and collective decisions.

31
Q

Front:
Topic: Top-down approach
Question: What is the top-down approach to algorithmic justice?

A

Answer: The top-down approach involves collective responsibility and regulation of algorithmic decision-making processes.

32
Q

Front:
Topic: Obligation to remedy
Question: What is the obligation to remedy in the context of algorithmic decision making?

A

Answer: The obligation to remedy involves addressing patterns of unfair outcomes caused by structural discrimination, where collective responsibility is proportional to power for harm/change.