Week 8 Flashcards
Deepfakes
- portmanteau for “deep learning” and “fake”
- hyper-realistic digital falsification of video and audio
- by leveraging machine-learning algorithms
- result: make someone say or do something
- early stage (!) of technology
Societal benefits deepfake
- education: historical figures speaking to students
- art: satirize, parody, and critique public figures
Social costs deepfake
- for individuals:
1. individual exploitation
2. reputational sabotage - for society:
1. distortion of democratic discourse
2. manipulation of elections
3. increasing social divisions
4. undermining journalism
Algorithmic solutions to overcome deepfake
Algorithm to detect deep fake based on blinking. Algorithm could then be linked with social media platforms.
Limitations:
- does not prevent making and spreading deepfakes
- detection patterns can be corrected in the next algorithm iteration
Digital Provenance Solutions to overcome deepfake
Digital watermark specifying when it was captured. Tag will be imprinted by the device capturing or creating the image (at point of creation)
Limitations:
- all devices should be equipped with the technology of watermark
- social media platforms must require these digital watermarks to post
- easier to spot opiniated people in authoritarian regimes
Privacy solutions to overcome deep fake
- legal ban on creating and sharing deep fakes online for nefarious reasons
Challenges:
a. when do you consider something a deep fake?
b. how to know the source?
c. what if the source is from a foreign country? - holding platforms accountable for monitoring and removing deep fakes
Challenges:
a. over-censoring to avoid fines?
b. how should platforms detect deep fakes?
c. what with freedom of expression?
General challenges for solutions to overcome deep fake
- not tackling the problem by its roots
2. how can you reach the whole society with literacy initiatives?
Definition Conversational agents
Software that accepts natural language as input an generates natural language as output, engaging in a conversation with the user
- virtual assistent (voice-based)
- chat bot (text-based)
Five steps conversational agents
- speech recognition (VA)
- natural language understanding (VA & CB)
- dialogue management (VA & CB)
- natural language generation (VA & CB)
- text-to-speech (VA)
Opportunities of conversational agents
Consumers:
- fast, immediate support, 24/7
- meeting consumers on the right platform
- conversational nature (increases engagement)
Organizations:
- substitute employees
- make employees more efficient (by taking over repetitive tasks)
- using logged data to increase organizational performances
Challenges research algorithms
- acces/black box
- heterogeneous and embedded
- ontogenetic, performative and contingent
Approaches research algorithms
- examining pseudo-code/source code
- reflexively producing code
- reverse engineering
- interviewing designers or ethnography of a team
- unpacking the full socio-technical assemblage
- examining how algorithms do work in the world
Examining pseudo-code/source code approach & limitations
- deconstructing the pseudo-code of algorithms
- looking at how codes are being rewritten/tweaked
- looking at how code for specific task is translated into various languages and runs across different platforms
Limitations:
- code is never straightforward (code jungle)
- expertise needed
Reflexively producing code approach and limitations
- critical reflection on own experiences of formulating an algorithm
- analysis of:
a. translating a task
b. writing and revising a code
c. influence of socio-technical factors
Limitations:
- detach oneself / critical distance
- focus is not on algorithms that have real concrete effects on people
Reverse engineering approach and limitations
- focus on input and output
- examining what data are fed into an algorithm and what output is produced
Limitations:
- not able to draw very specific conclusions
- Fuzzy glimpse of the algorithms
