Statistician raises red flag about reliability of machine learning techniques

Machine learning is everywhere in science and technology: powering facial recognition, picking your recommendations on Netflix, and controlling self-driving cars. But how reliable are machine learning techniques really? A statistician says that the answer is “not very,” arguing that questions of accuracy and reproducability of machine learning have not been fully addressed.

Dr Genevera Allen, associate professor of statistics, computer science, and electrical and computer engineering Rice University in Houston, Texas has discussed this topic at a press briefing and at a scientific conference, the 2019 Annual Meeting of the American Association for the Advancement of Science (AAAS). She warned that researchers in the field of machine learning have spent so much time developing predictive models that they have not devoted enough attention to checking the accuracy of their models, and that the field must develop systems which can assess the accuracy of their own findings.

“The question is, ‘Can we really trust the discoveries that are currently being made using machine-learning techniques applied to large data sets?'” Allen said in a statement. “The answer in many situations is probably, ‘Not without checking,’ but work is underway on next-generation machine-learning systems that will assess the uncertainty and reproducibility of their predictions.”

As an example, recently machine learning has been used to study patients with cancer. To study the disease, scientists use machine learning to identify genetically similar individuals so that drug therapies can then be targeted to these specific genomes. But when comparing across different studies, the clusters identified by machine learning are completely different from each other.

The problem is that machine learning techniques do not have a way to say “I don’t know” or “It’s not clear.” The techniques will generally always produce an answer — in the example of the cancer patients, they will always identify a group in some way — but this answer may not be as certain or accurate as it is believed to be. The techniques are able to find a pattern that exists in the data set, even if only dimly, but the pattern may not hold in the real world.

“There is general recognition of a reproducibility crisis in science right now,” Allen told BBC News. “I would venture to argue that a huge part of that does come from the use of machine learning techniques in science.”

Gaming

Apex Legends cheaters and spammers will be matched up against each other

Apex Legends cheaters will be matched up against each other, as part of Respawn's continuing fight against cheating. The developer is also working on using machine learning to create models for automatically banning cheaters.
Deals

Amazon cuts 44% off on Fisher-Price Smart Cycle for Kids this Prime Day

The Fisher-Price Think & Learn Smart Cycle is currently discounted by $48 from its original price of $110. Only for Prime Day, you can take it home to your kids for the amazing price of only $62.
Deals

Amazon slashes prices for LectroFan white noise sound machines for Prime Day

It's a noisy world out there and sometimes masking the noise is the only way you can concentrate, relax, or go to sleep. Amazon slashed the price of three Adaptive Sound Technologies LectroFan sound machines for Amazon Prime Day 2019.
Small Business

The 15 best tech jobs boast top salaries, high satisfaction, lots of openings

June may be ending, but the bonanza of tech jobs just keeps coming. High-paying jobs abound at companies where people love to work. If you’re ready to make a change, this is a great time to look for something more fulfilling.   
Emerging Tech

Professional poker players no match for A.I. in six-player Texas Hold ’em

Poker AI Pluribus destroyed professional players in Texas Hold 'em. The bot won an average of $5 per hand with winnings of $1,000 per hour, with strategies that were very different to how humans played the game.
Emerging Tech

Russia launches X-ray observatory capable of locating thousands of black holes

Russia has finally launched its powerful X-ray observatory, Spektr-RG, after a delay caused by faulty batteries on board the spacecraft. The launch took place at 5:30 a.m. PT on Saturday, July 13, taking off from the Baikonur Cosmodrome.
Emerging Tech

Stallone in Terminator 2? How one deepfake prankster is changing cinema history

Ever wanted to see The Shining with Jim Carrey instead of Jack Nicholson? How about Stallone in Terminator 2: Judgement Day instead of everyone's favorite governator? Thanks to deepfakes, it's now possible -- just ask YouTuber Ctrl Shift…
Emerging Tech

See a gargantuan dust storm covering the north pole of Mars

A dust storm around Mars' north pole has been imaged by the Mars Express orbiter. Localized dust storms are common on Mars, but occasionally one expands into a planet-wide event like the one which caused the demise of the Opportunity rover.
Emerging Tech

The Very Large Telescope captures the beautiful remnants of a dying star

The VLT has captured a beautiful cosmic object, the planetary nebula named Abell 24. Located in constellation of Canis Minor (The Lesser Dog), it is a swirl of dust and gas which is illuminated by the core of a dead star.
Emerging Tech

Astronomers have spotted a moon forming around a proto-Jupiter

Astronomers have spotted a young planet with a disk of gas and dust around it which is similar to the one from which the moons of Jupiter were born. The planet PDS 70 b is in the process of forming and is located 370 light-years away.
Emerging Tech

NASA thinks 3D-printing spacecraft parts in orbit will help Moon to Mars mission

NASA funded the demonstration by a small spacecraft named Archinaut One to manufacture and assemble parts while in space. NASA believes that the technology will change future space exploration, including its Moon to Mars initiative.
Emerging Tech

Flyboard Air soars over Paris during France’s national day celebrations

Franky Zapata, the inventor of the jet-powered Flyboard Air, showed off his machine during France's Bastille Day celebrations on Sunday. The impressive display was even given a nod of approval by French President Emmanuel Macron.
Deals

Save with Prime Day deals on DNA kits from Ancestry, 23andme, and Living DNA

Prime Day is a great time to order a DNA kit. Over the years, kits from various providers have been deeply discounted -- and this year's no exception. Kits from AncestryDNA, 23andMe, and Living DNA are on sale for as much as half off…
Emerging Tech

Airport hotel builds a full-sized flight simulator into one of its guest rooms

Aviation enthusiasts flying out of Tokyo's Haneda Airport, there's a new hotel room designed just for you. It features a full-sized Boeing 737-800 flight simulator, though you'll have to pay extra to use it.