Dystopian Technologies Emerging in Today's Society
Written on
In recent years, Silicon Valley has produced a myriad of groundbreaking technologies. However, with major players like Amazon, Google, and Facebook leading the charge, some of these innovations come with concerning features, such as extensive personal data tracking. This situation raises the question of whether even more invasive surveillance technologies are on the horizon. Here, we examine ten unsettling technological advancements that are taking shape.
The Amazon Ring Home Security System: A Privacy Concern
Home security has been a priority for quite some time, with numerous tech companies, including Amazon and Google, entering the market with their products. While some offerings, like Google Nest, may appear benign, others spark significant privacy concerns. The Amazon Ring is a prime example, as it has raised eyebrows within the tech community.
The Amazon Ring consists of a camera that can autonomously navigate a home, monitoring it in the absence of its occupants. It is equipped with sensors that can detect intruders and alert both homeowners and law enforcement. However, its ability to constantly monitor raises comparisons to Orwellian surveillance. Amazon claims that the device only records while in motion, yet it remains perpetually connected to its servers.
Smart Caskets: Posting to Social Media Beyond the Grave
Funeral arrangements seem like an unlikely domain for smart technology, yet one company is making strides in this area with digital smart coffins. Perfect Choice Funerals conceived the idea after researching the intersection of technology and funerals, noting that friends and family often share photos of the deceased on social media.
These caskets feature LCD screens that display images and messages from social media, keeping the deceased's presence alive in the digital realm. While innovative, this concept raises unsettling questions about whether constant social media connectivity has crossed a line. The notion of the deceased continuing to post on platforms like Facebook after their passing is quite disconcerting.
AI Apps Assessing Babysitters: A Risky Approach
Finding a reliable babysitter can be challenging, and while some solutions exist, others may not be advisable. The company Predictim has developed AI software designed to analyze background histories and assess babysitter suitability. However, this technology is still evolving and has inherent flaws, including potential racial biases.
Gizmodo's Brian Merchant tested the software with two babysitters—one Black and one White. Surprisingly, the AI rated the Black babysitter lower, despite both being trusted by Merchant's family. This does not imply intentional racism from the company but highlights the unfortunate biases present in AI systems. The ability to sift through someone's background to assess risk factors feels alarmingly dystopian.
Deep Voice Technology: The Threat of Voice Cloning
Deepfake technology poses significant risks, with increasingly convincing applications emerging. This capability extends to audio deepfakes, which can replicate anyone's voice using AI and audio samples. Criminals have already exploited this technology, leading to substantial financial losses.
In a notable incident in 2020, thieves used deepfake audio to trick a bank manager into transferring $35 million to a fraudulent account. The manager believed he was conversing with the account holder, only to be deceived by a synthetic voice. This incident underscores the peril of voice cloning technology, where anyone's voice could be mimicked, resulting in identity theft.
Dove Drones in China: Surveillance in Disguise
Chinese authorities are testing bird-like drones for surveillance purposes, as part of a project led by Professor Song Bifeng from Northwestern Polytechnic University. These drones are designed to mimic the flight patterns of real doves, making them difficult for the public to detect, as they operate almost silently.
Intended for various applications, including law enforcement and surveillance of citizens, this technology is still in early development. However, its potential for misuse raises significant concerns, especially with military and policing applications already being explored.
Facial Recognition Sunglasses for Law Enforcement
Facial recognition technology is becoming alarmingly prevalent, especially in China, where law enforcement has adopted sunglasses equipped with this capability. Introduced in Zhengzhou in 2018, these glasses have helped capture multiple criminals.
These devices are deployed in various public spaces, including train stations and shops. The Chinese government has also installed millions of surveillance cameras, making it nearly impossible for citizens to evade recognition. The implications for privacy and civil liberties are troubling, as this technology could facilitate widespread human rights violations.
Boston Dynamics: Robots Designed for Combat
Boston Dynamics has gained recognition for developing advanced robots capable of mimicking human and animal movements. Although these robots have fascinated the public, concerns about their potential applications persist.
A 2019 video showcasing robots engaging in combat raised alarms, as testers struck the machines, which retaliated with surprising force. The video was so realistic that the production team had to clarify that no participants were harmed. The military and law enforcement potential of such technology is significant, leading to fears of a future where robots could turn against their creators.
Patrol Robots in Singapore: Monitoring Social Behavior
In 2021, Singapore initiated a trial involving robots that can issue warnings to individuals for "undesirable behavior." This initiative is part of Singapore's ambition to become a "smart nation." However, critics argue that this approach infringes on privacy and limits control over personal data.
Equipped with seven cameras, these robots can detect behaviors such as smoking in prohibited areas and violating social distancing rules. During the trial, one robot issued warnings to residents, prompting concerns over the growing surveillance culture in the city. With plans to increase surveillance cameras and potentially implement facial recognition technology, Singaporeans may find themselves under heightened scrutiny.
China’s Social Credit System: A New Form of Governance
China's social credit system represents a significant advancement in surveillance, evaluating citizens' behavior and assigning moral ratings. Launched in 2014, this program aims to promote trustworthiness while penalizing violations.
Various organizations, including government bodies and private enterprises, contribute to the ratings, and millions of citizens have participated in pilot programs. The government intends to standardize this system across the country, assigning unique codes to individuals that reflect their social credit scores in real-time. Infractions such as poor driving or unpaid debts can negatively impact one's rating, raising concerns about the overarching control exerted by the state.
Amazon's Employee Monitoring: The Dystopia of Work
Amazon has come under scrutiny for its automated employee monitoring practices, which include productivity quotas and automated terminations. Documents reveal that the company has terminated hundreds of employees for failing to meet these quotas, with estimates suggesting that over 10% of its workforce may be dismissed annually for productivity reasons.
This reliance on automation to manage employee performance raises significant ethical concerns, as human oversight is virtually absent. The harsh working conditions reported by many Amazon employees, who are often expected to pack hundreds of boxes each hour, highlight the potential for serious errors and the dehumanization of the workforce.
References
- bbc.com/news/technology-54285692
- mentalfloss.com/article/70154/smart-casket-design-keeps-corpses-connected-social-media
- gizmodo.com/predictim-claims-its-ai-can-flag-risky-babysitters-so-1830913997
- reviewgeek.com/100638/thieves-used-deepfake-voice-technology-to-pull-off-a-35-million-bank-heist/
- businessinsider.com/china-is-testing-creepy-dove-drones-to-monitor-citizens-2018–6
- bbc.com/news/world-asia-china-42973456
- popularmechanics.com/technology/robots/a28068919/robot-fights-humans/
- theguardian.com/world/2021/oct/06/dystopian-world-singapore-patrol-robots-stoke-fears-of-surveillance-state
- businessinsider.com/china-social-credit-system-punishments-and-rewards-explained-2018–4
- theverge.com/2019/4/25/18516004/amazon-warehouse-fulfillment-centers-productivity-firing-terminations