Tuesday, May 21, 2024
HomeRoboticsTangram Imaginative and prescient packs AI expertise onto HiFi 3D sensor

Tangram Imaginative and prescient packs AI expertise onto HiFi 3D sensor


Take heed to this text

Voiced by Amazon Polly

In the event you’ve ever talked to the oldsters at Tangram Imaginative and prescient, chances are high you got here away extra educated concerning the state of notion for robotics. The group on the Boulder, Colo.-based startup has 60-plus years of mixed expertise with notion and sensors.

Based in 2020, it has developed a toolset to assist roboticists resolve notion issues similar to multimodal sensor calibration, sensor fusion and sensor uptime. And now it’s making its first foray into robotic notion {hardware} with a 3D depth sensor known as HiFi that packs a robust AI punch as nicely.

HiFi launched on Kickstarter with early backers capable of get a HiFi for $349, which is 36% off the $549 retail value. Tangram surpassed its $25,000 purpose 4 hours after launching it; at press time, the marketing campaign had raised greater than $40,000. Tangram expects to ship the primary HiFi items in April 2024.

The Tangram Imaginative and prescient group got here out of Occipital, the spatial computing firm that launched the Construction Sensor 3D sensor with a $1.3 million marketing campaign on Kickstarter in 2013.

“Instruments for robotics and AI have come a great distance up to now few years, however sensors haven’t saved tempo,” stated Brandon Minor, CEO, Tangram Imaginative and prescient. “After talking with a whole lot of robotics and AI engineers, we knew they wished to spend much less time battling sensors and extra time constructing cool merchandise. HiFi makes it lifeless easy so as to add AI-enhanced 3D information to robots and extra.”

HiFi 3D sensor mounted onto a collaborative robot arm from Universal Robots

A HiFi 3D sensor mounted onto a cobot arm from Common Robots. Supply: Tangram Imaginative and prescient

HiFi’s capabilities

HiFi makes use of ams Mira220 cameras. It combines a 136° subject of view 2-megapixel international shutter IR stereo pair with a 136° subject of view 2-megapixel RGB digital camera and twin energetic projectors. A 65mm baseline delivers depth from 0.3m to 5m with 30-60 frames per second. Due to its subject of view, Tangram stated roboticists can substitute two depth sensors with a single HiFi in lots of purposes.

HiFi features a host of software program, drivers and onboard instruments for roboticists. For instance, it’s designed to natively work with ROS 2. It comes with 8 TOPS of machine studying processing energy that permits on-sensor fusion of AI and 3D information. It additionally has 8GB of onboard reminiscence that Tangram stated allows neural networks to be run onboard HiFi.

It encompasses a devoted depth processor on the Texas Devices (TI) Jacinto chip. Tangram stated the Jacinto processor lets HiFi provide compatibility with the TI’s Deep Studying Library that comes with ready-to-deploy fashions for scene segmentation, pose estimation, object identification, object monitoring and extra. HiFi additionally comes geared up with Tangram’s sensor software program instruments like self-calibration, time sync, and uptime administration.


SITE AD for the 2024 Robotics Summit call for presentations.Submit a session summary now to be an occasion speaker. Submission Deadline: December 15, 2023


Robotics purposes

Tangram advised The Robotic Report it by no means had any intention of growing a 3D sensor. But it surely stated it was compelled to take action after so a lot of its robotics clients expressed disappointment with the state of 3D sensing.

“Proper now, robotics engineers should select between 3D information high quality, AI capabilities, or reliability. However they actually need all three,” stated Minor.

In a testimonial for the HiFi marketing campaign, Nathan Brooks, CTO of PickNik, seemingly agreed. He stated his firm has “been speaking with Tangram for years and sharing a few of our pains in deploying robotic purposes in the true world and unstructured environments.”

Rodnitzky stated cell robotics has traditionally been Tangram’s bread and butter. However he stated HiFi will allow the corporate to work with several types of robots and purposes.

“Bin-picking purposes didn’t make sense for us earlier than, however now they do,” he stated. “This might permit us to additionally dip our toes into industrial automation the place Zivid, IDS and Cognex have dominated with dearer sensors.”

Market alternative

To grasp the chance Tangram envisions for HiFi, simply have a look at the volatility of the depth sensor market lately. The Kinect was as soon as a stable possibility, however that died when Apple acquired PrimeSense for $360 million in 2013. Google shut down Mission Tango in late 2017 after a promising three years. And Intel almost shuttered its RealSense division earlier than deciding to proceed introducing new depth sensors.

Tangram doesn’t have the dimensions of these aforementioned firms. However Minor doesn’t suppose that’s a difficulty.

“I don’t know if of us belief these bigger gamers. There’s threat there as nicely,” he stated. “We don’t have as many mouths to feed, and this may very well be game-changing for the business and our firm.”

Minor additionally stated promoting HiFi is a chance for Tangram to introduce its calibration providers, and its recurring income mannequin, to firms which have by no means heard of it earlier than.

“We launched Tangram to decrease the barrier to entry into laptop imaginative and prescient,” stated Minor. “That’s why we began with calibration – it’s an unimaginable job that’s very laborious to do. HiFi is yet another piece of that puzzle. Allow us to construct a sensor that meets depth information high quality requirements and comes with superb AI processing capabilities to do refined processes. And roboticists can concentrate on purposes and what they do nicely.”

RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular

Recent Comments