Explore challenges and solutions in AI chip development
LiDAR stands for Light Detection and Ranging. It works by sending laser light from a transmitter, which then reflects off objects in the environment. The system’s receiver detects the reflected light, and by measuring the time it takes for the light to travel to and from each object (known as the time of flight), LiDAR creates a detailed distance map of the scene.
LiDAR is an optical technology often cited as a key method for distance sensing for autonomous vehicles. Many manufacturers are working to develop cost-effective, compact LiDAR systems. Virtually all producers pursuing autonomous driving consider LiDAR a key enabling technology, and some LiDAR systems are already available for Advanced Driver Assistance Systems (ADAS).
A birds-eye view of the concept of LiDAR systems used in Advanced Driver Assistance Systems.
LiDAR sensor for self-driving car, located under a side mirror. LiDAR systems can also be located on top of an autonomous car.
Essentially, LiDAR is a ranging device, which measures the distance to a target. The distance is measured by sending a short laser pulse and recording the time lapse between outgoing light pulse and the detection of the reflected (back-scattered) light pulse.
A LiDAR system may use a scan mirror, multiple laser beams, or other means to "scan" the object space. With the ability to provide accurate measurement of distances, LiDAR can be used to solve many different problems.
In remote sensing, LiDAR systems are used to measure scatter, absorption, or re-emission from particles or molecules in the atmosphere. For these purposes, the systems may have specific requirements on the wavelength of the laser beams. The concentration of a specific molecular species in the atmosphere, e.g. methane and the aerosol loading, can be measured. Rain droplets in the atmosphere can be measured to estimate the distance of a storm and the rain fall rate.
Other LiDAR systems provide profiles of three-dimensional surfaces in the object space. In these systems, the probing laser beams are not tied to specific spectral features. Instead, the wavelength of the laser beams may be chosen to ensure eye safety or to avoid atmospheric spectral features. The probing beam encounters and is reflected by a "hard target" back to the LiDAR receiver.
LiDAR can also be used to determine the velocity of a target. This can be done either through the Doppler technique or measuring the distance to a target in rapid succession. For example, atmospheric wind velocity and the velocity of an automobile can be measured by a LiDAR system.
In addition, LiDAR systems can be used to create a three-dimensional model of a dynamic scene, such as what may be encountered by an autonomous driving vehicle. This can be done in various ways, usually using a scanning technique.
Essentially, LiDAR is a ranging device, which measures the distance to a target. The distance is measured by sending a short laser pulse and recording the time lapse between outgoing light pulse and the detection of the reflected (back-scattered) light pulse.
Operational LiDAR systems face several well-known challenges, which can vary depending on the specific type of system. Some common examples include:
Signal Isolation and Rejection: The emitted probing beam is usually much stronger than the return beam. It’s important to prevent the probing beam from reflecting or scattering back into the receiver, as this can saturate the detector and prevent it from identifying external targets.
Spurious Returns from Atmospheric Debris: Particles or debris in the atmosphere between the transmitter and the intended targets can produce strong, unwanted signals. These spurious returns may interfere with the reliable detection of the actual target.
Optical Power Limitations: Higher beam power improves accuracy but increases operational costs. Balancing power and cost is a key consideration for LiDAR system designers.
Scanning Speed and Safety: Rapid scanning can raise safety concerns if the laser operates at frequencies harmful to human eyes. Solutions like flash LiDAR, which illuminates a large area at once, and using eye-safe wavelengths, help address these safety issues.
Device Crosstalk: Signals from nearby LiDAR devices can interfere with each other, making it difficult to distinguish between different sources. Techniques such as signal chirping and improved isolation are being developed to overcome this challenge.
Cost and Maintenance: LiDAR systems are generally more expensive than some other sensor technologies. However, ongoing development aims to reduce costs and make LiDAR more accessible for wider use.
Rejection of Returns from Unintended Objects: Unwanted signals can also occur in clear air, not just in the presence of atmospheric debris. Addressing this often involves minimizing the beam size at different target distances and optimizing the receiver’s field-of-view to better filter out irrelevant signals.
These challenges are the focus of active research and development to improve the reliability, safety, and affordability of LiDAR technology.
The application areas for LiDAR are deep and varied. In atmospheric sciences, LiDAR has been used for the detection of many types of atmospheric constituents. It has been used to characterize aerosols in the atmosphere, investigate upper atmospheric winds, profile clouds, aid the collection of weather data, and many other applications. In astronomy, LiDAR has been used to measure distances, both for distant objects such as the moon and for very near objects. In fact, LiDAR is a crucial device for improving the measurement of the distance to the moon up to millimeter precision. LIDAR has also been used to create guide stars for astronomy applications.
Automobile sensors in self-driving cars use camera data, radar, and LiDAR to detect objects around it.
Source: NOAA and https://lidarmag.com/2019/12/04/not-just-for-surveying-lidars-big-impact-in-weather/
LiDAR data is often collected by air, such as with this NOAA survey aircraft (right) over Bixby Bridge in Big Sur, Calif. Here, LiDAR data revelas a top-down (top left) and profile view of Bixby Bridge. NOAA scientists use LiDAR-generated products to examine both natural and manmade environments. LiDAR data supports activities such as inundation and storm surge modeling, hydrodynamic modeling, shoreline mapping, emergency response, hydropgraphic surveying, and coast vulnerability analysis.
Source: NOAA - https://geodesy.noaa.gov/INFO/facts/lidar.shtml
Furthermore, topographic LiDAR uses a near-infrared laser to map the land and buildings, and bathymetric LiDAR uses water-penetrating green light to map seafloor and riverbed. In agriculture, LiDAR can be used to map topology and crop growth, which can provide information on fertilizer needs and irrigation requirements. In archaeology, LiDAR has been used to map ancient transportation systems under thick forest canopy.
Today, LiDAR is frequently used to create a three-dimensional model of the world around the LiDAR sensor. Autonomous navigation is one application that uses the point cloud created by a LiDAR system. Miniature LiDAR systems can even be found in devices as small as mobile phones.
One fascinating application for LiDAR is situational awareness for things like autonomous navigation. The situational awareness system for any moving vehicle needs to be aware of both stationary and moving objects around it. For example, radar has been used for a long time in detecting aircraft. LiDAR has been found very helpful for terrestrial vehicles because it can ascertain the distance to objects and is very precise in terms of directionality. The probing beams can be directed to precise angles and scanned quickly to create the point cloud for the three-dimensional model. The ability to scan quickly is key for this application since the situation surrounding the vehicle is highly dynamic.
Automobile sensors in self-driving cars use camera data, radar, and LiDAR to detect objects around it
Autonomous car uses LiDAR sensors to detect surrounding buildings and cars
Software is key to every aspect of LiDAR system creation and operation. There are multiple software needs for the design of LiDAR systems. The system engineer needs a radiometric model to predict the signal-to-noise ratio of the return beam. The optical engineer needs software to create the optical design. The electronics engineer needs an electronics model to create the electrical design. The mechanical engineer needs a CAD package to accomplish the system layout. Structural and thermal modeling software may also be needed. The operation of LiDAR systems requires control software and reconstruction software that converts the point cloud to a three-dimensional model.
Synopsys offers several optical and photonic tools to support LiDAR system and components design:
Optimized LiDAR receiver optical system, simulated in CODE V
LiDAR optical system, simulated in LightTools
Combined RSoft tools used for different elements of the
LiDAR-On-Chip design