Connect with us

Technology

Inbred, gibberish or just MAD? Warnings rise about AI models | The Express Tribune

Published

on


When academic Jathan Sadowski reached for an analogy last year to describe how AI programs decay, he landed on the term “Habsburg AI”.

The Habsburgs were one of Europe’s most powerful royal houses, but entire sections of their family line collapsed after centuries of inbreeding.

Recent studies have shown how AI programs underpinning products like ChatGPT go through a similar collapse when they are repeatedly fed their own data.

“I think the term Habsburg AI has aged very well,” Sadowski told AFP, saying his coinage had “only become more relevant for how we think about AI systems”.

The ultimate concern is that AI-generated content could take over the web, which could in turn render chatbots and image generators useless and throw a trillion-dollar industry into a tailspin.

But other experts argue that the problem is overstated, or can be fixed.

And many companies are enthusiastic about using what they call synthetic data to train AI programs. This artificially generated data is used to augment or replace real-world data. It is cheaper than human-created content but more predictable.

“The open question for researchers and companies building AI systems is: how much synthetic data is too much,” said Sadowski, lecturer in emerging technologies at Australia’s Monash University.

Training AI programs, known in the industry as large language models (LLMs), involves scraping vast quantities of text or images from the internet.

This information is broken into trillions of tiny machine-readable chunks, known as tokens.

When asked a question, a program like ChatGPT selects and assembles tokens in a way that its training data tells it is the most likely sequence to fit with the query.

But even the best AI tools generate falsehoods and nonsense, and critics have long expressed concern about what would happen if a model was fed on its own outputs.

In late July, a paper in the journal Nature titled “AI models collapse when trained on recursively generated data” proved a lightning rod for discussion.

The authors described how models quickly discarded rarer elements in their original dataset and, as Nature reported, outputs degenerated into “gibberish”.

A week later, researchers from Rice and Stanford universities published a paper titled “Self-consuming generative models go MAD” that reached a similar conclusion.

They tested image-generating AI programs and showed that outputs become more generic and strafed with undesirable elements as they added AI-generated data to the underlying model.

They labelled model collapse “Model Autophagy Disorder” (MAD) and compared it to mad cow disease, a fatal illness caused by feeding the remnants of dead cows to other cows.

These researchers worry that AI-generated text, images and video are clearing the web of usable human-made data.

“One doomsday scenario is that if left uncontrolled for many generations, MAD could poison the data quality and diversity of the entire internet,” one of the Rice University authors, Richard Baraniuk, said in a statement.

However, industry figures are unfazed.

Anthropic and Hugging Face, two leaders in the field who pride themselves on taking an ethical approach to the technology, both told AFP they used AI-generated data to fine-tune or filter their datasets.

Anton Lozhkov, machine learning engineer at Hugging Face, said the Nature paper gave an interesting theoretical perspective but its disaster scenario was not realistic.

“Training on multiple rounds of synthetic data is simply not done in reality,” he said.

However, he said researchers were just as frustrated as everyone else with the state of the internet.

“A large part of the internet is trash,” he said, adding that Hugging Face already made huge efforts to clean data — sometimes jettisoning as much as 90 percent.

He hoped that web users would help clear up the internet by simply not engaging with generated content.

“I strongly believe that humans will see the effects and catch generated data way before models will,” he said.

Technology

SpaceX achieves unprecedented feat in commercial space travel | The Express Tribune

Published

on

By



WASHINGTON:

Two astronauts, a billionaire and an engineer, completed the first private spacewalk in orbit on Thursday outside a SpaceX capsule. They wore a new type of spacesuit in a high-risk feat once limited to astronauts from government space agencies.

As part of the Polaris Dawn mission, the astronauts each spent about 10 minutes outside the Crew Dragon capsule, tethered for safety, while their two crewmates remained inside. The mission, led by Elon Musk’s SpaceX, further pushed the boundaries of private space travel.

Jared Isaacman, a pilot and founder of Shift4, was the first to exit, followed by SpaceX engineer Sarah Gillis. Meanwhile, their crewmates Scott Poteet and Anna Menon observed from inside the capsule. Orbiting about 450 miles (730 km) above Earth, the entire spacewalk lasted one hour and 46 minutes.

Isaacman, who also funded the Polaris mission, previously financed his Inspiration4 flight with SpaceX in 2021. The mission, streamed live on SpaceX’s website, tested new equipment, including slimmer spacesuits and a procedure to fully depressurise the Crew Dragon cabin – technology that Musk aims to refine for future private missions to Mars.

After re-entering the spacecraft, Isaacman commented on Earth’s beauty, as seen from space. This mission was one of the riskiest for SpaceX, the only private company capable of regularly sending people into orbit and back.

Before the spacewalk at around 10:52 GMT, the capsule was completely depressurised, with the astronauts relying on their SpaceX-designed spacesuits for oxygen via an umbilical connection to the capsule. Isaacman, 41, and Gillis, 30, tested the suits’ flexibility and provided feedback to improve future designs.

The mission aimed to push the limits of private companies in space, with ground teams at SpaceX’s California headquarters monitoring the hatch’s closure and carrying out safety checks as the astronauts returned inside.

The spacewalk procedure echoed that of the first US spacewalk in 1965, which involved depressurising the capsule and tethering a spacesuited astronaut to it. NASA Administrator Bill Nelson hailed the mission as a “giant leap forward” for the commercial space industry and NASA’s goal of building a sustainable US space economy.

While Isaacman has not revealed the mission’s cost, it is expected to run into hundreds of millions, with Crew Dragon seats typically costing around $55 million each.

Gillis, who joined SpaceX as an intern in 2015, and Poteet, a retired US Air Force lieutenant colonel, were among the crew, along with SpaceX engineer Anna Menon. Throughout the mission, the spacecraft circled Earth multiple times, reaching altitudes of up to 1,400 km, the farthest humans have travelled in space since Apollo’s final mission in 1972.

Spacewalks have previously been conducted solely by government-trained astronauts. Since the International Space Station (ISS) was established in 2000, there have been around 270 spacewalks, with 16 on China’s Tiangong space station.

The Polaris crew spent two and a half years training, including mission simulations and challenging real-world experiences, to prepare for the mission, according to Poteet.

Currently, a record 19 astronauts are in orbit, including 12 aboard the ISS, after a Russian Soyuz mission transported additional astronauts there on Wednesday. Since 2001, Crew Dragon has completed more than a dozen astronaut missions, primarily for NASA.

The capsule was developed under a NASA programme to create commercial vehicles for transporting astronauts to and from the ISS. Boeing’s Starliner capsule, also part of this programme, launched its first astronauts to the ISS in June but faced difficulties. It returned empty, leaving its crew aboard the station until next year, when a Crew Dragon capsule will retrieve them.

Continue Reading

Technology

PS5 Disc Drive is selling out after PS5 Pro announcement | The Express Tribune

Published

on

By


Listen to article

The demand for the PS5 Disc Drive has skyrocketed since the announcement of the PS5 Pro, with online retailers quickly selling out of the popular peripheral.

Gamers eager to ensure they can still play physical media on their next-gen consoles are rushing to purchase the external disc drive required for the new PS5 Pro.

Sony officially revealed the PS5 Pro earlier this week, and with it came the announcement that the console would not include a built-in disc drive.

Instead, players who want to use physical discs will need to buy the external PS5 Disc Drive, a shift that has already sparked a buying frenzy.

At the time of writing, the PS5 Disc Drive has climbed to #16 on Amazon’s best-selling video game products.

Best Buy, one of the major online retailers, has already sold out of the drive, and it is currently unavailable for order. Gamers are still able to find it on other major sites like Target, Walmart, and PlayStation Direct, but these supplies are expected to diminish quickly as well.

This rush to secure the PS5 Disc Drive began when Sony introduced the PS5 Slim in late 2023, which also required an external drive for physical game compatibility. Unlike the original PS5, which featured both disc and digital editions, the Slim removed the option of having a built-in disc drive.

 

 

Continue Reading

Technology

US wireless data usage surges to record 100 trillion MB in 2023 | The Express Tribune

Published

on

By


Americans consumed more than 100 trillion megabytes of wireless data in 2023, a 36% rise from the previous year and the largest single-year increase, according to a report from wireless industry association CTIA.

The surge in usage—an increase of 26 trillion MB over 2022—is attributed to the growing adoption of 5G devices and fixed wireless access (FWA) broadband services.

The total number of wireless connections in the US rose to 558 million, representing a 6% growth over 2022. Notably, 40% of wireless connections were 5G-enabled, covering over 330 million US residents.

Additionally, nearly 40% of all wireless devices were connected to 5G, a 34% increase from 2022.

CTIA highlighted that the sector attracted $30 billion in investment in 2023, with total spending on spectrum auctions surpassing $233 billion.

However, the association emphasized the need for Congress to restore the Federal Communications Commission’s (FCC) auction authority to ensure access to mid-band spectrum and meet the growing demand for wireless services.

By the end of 2023, the US had 432,469 active cell sites, a 24% increase since 2018, thanks to siting reforms.

The cost per megabyte of wireless data has dropped by 50% since 2020.

CTIA’s annual survey has tracked the US wireless sector since 1985.

Continue Reading

Technology

Black Sun Productions to launch VR game inspired by Kafka’s Metamorphosis | The Express Tribune

Published

on

By


Listen to article

Black Sun Productions, a virtual reality studio, has announced its debut title, Metamorphosis VR, will launch on October 10, 2024.

The narrative inspired by Franz Kafka’s The Metamorphosis will be available for Meta Quest 2 and 3.

This VR game offers a unique and immersive experience, allowing players to step into the surreal world of Kafka’s renowned novella.

Metamorphosis VR is a bold reimagining of the 2020 PC game Metamorphosis, originally developed by Ovid Works and Untold Tales.

The story takes place in early 1900s Vienna, following Gregor Samsa, a traveling salesman who undergoes a shocking transformation into a cockroach.

After a night out, Gregor awakens to discover his metamorphosis and embarks on a strange journey to find a way to return to his human form and save his closest friend.

“We chose Metamorphosis as our debut title for Black Sun because its surreal, Kafkaesque world – some of the richest and most immersive environments imagined – offers a perfect opportunity to bring this extraordinary experience to virtual reality,” said Corbin Chase, CEO of Black Sun Productions, in a statement, as reported by VentureBeat.

“One of VR’s most powerful abilities is how it changes our perspective and sense of scale, and Metamorphosis uniquely combines confusion, bewilderment, wonder and beauty. All imparted by that shift in perspective, it feels like this game was always meant for VR.”

One of the game’s key highlights is its distinct shift in perspective, which allows players to experience Gregor’s new reality as an insect.

Navigating through walls, floorboards, and tight spaces, the player is immersed in a bizarre world filled with bug philosophers, insect crime bosses, and creepy thespians.

The game features over 100 insect characters, each with a unique voice, contributing to an interactive experience.

Fans of Kafka’s original novella and virtual reality enthusiasts eager to explore its surreal world are anticipating the game’s October 10 release on Meta Quest 2 and 3.

 

Continue Reading

Trending