July 6th, 2015 Comments off
Garbage in Garbage outIt is amazing that 3D models can be created from regular (uncalibrated) pictures. This link shows some nice examples of how uncalibrated images can be used to make 3D models.
Quality in Quality outOur approach is harder, but our results are better. We precisely calibrate our cameras, and we use the calibrated pictures to make 3D models. As our calibration improves, our 3D models improve. The combination of better calibration and sub-pixel processing has allowed us to create models that are accurate to within 1 or 2 millimeters at 10 feet. Also, our new color processing routine adjusts lighting and allows the colors in different 3D scans to blend better. More accurate scan geometry and better color control results in better looking 3D models. The video below demonstrates our latest improvments. The complete 3D model in our video consists of 13 scans from 13 different locations. I believe that we have tackled the hardest part of the problem: calibration. Now that our geometry is correct, we can focus on making our 3D models attractive and easy to work with. We will continue improving the system in the following three ways: 1) FASTER HARDWARE We are finalizing the Proto-5B design. The current system takes about 7 minutes to create a single scan, and the next iteration of our scanner will capture the imagery at least 20 times faster. ETA for this system is April 2016. 2) IMPROVED PHOTOREALISM WITH POST-PROCESSING Post-processing imagery is normal. Photoshop is often used to clean up 2D pictures, and many 3D programs can clean up our 3D data. We are evaluating several programs, and will make our data work with the best solution(s). 3) INCREASED COMPATIBILITY WITH EXISTING 3D STANDARDS Make it easier to move our data to other software like Unity, Meshlab, SketchUp, and possibly Matterport. Being compatible with Unity will make us compatible with headsets like Oculus, and that will allow a photorealistic 3D VR experience.
June 11th, 2015 Comments off
Here is an example of our latest results after a few more weeks of tuning the noise reduction controls. Now that most artifacts and distortion are sufficiently reduced, we will begin merging scans to produce larger models.
May 20th, 2015 Comments off
We have steadily improved our scanning results over the last 6 weeks by modifying hardware, writing new software, and tuning over a dozen variables. The video below demonstrates the effect of our enhanced noise reduction: Low noise in 3D models is important for two reasons:
- Low noise 3D looks better.
- Low noise 3D models are easier to compress & display. In many cases smoothing should allow us to reduce a scan to less than 1% of the original size.
March 29th, 2015 Comments off
Here is an early 3D scan from our latest prototype scanner. EARLY is a key word here, because our scanner has only been operational for a couple of weeks. During the last year my team has completely upgraded the scanner hardware including cameras, lenses, chassis, and calibration tools. We have also ported our software from from Windows to Linux and from CUDA to OpenCL. We have weeks of fine-tuning and calibration that still needs to be done, but we feel that the early results are worth posting. The new system is called Proto-5A, and below lists the most significant improvements over its predecessor Proto-4F:
- Produces higher resolution 3D scans
- Scans 10x to 20x faster
- Uses less power
- Scans with nearly 100% reliability
- Find a partner interested in moving the Proto-5x concept forward. The ideal partner could support our development plan, or we could jointly develop a new plan. The 3D-360 IP is valuable, and we need a partner willing to help defend our international 3D-360 patents.
- Expand the capabilities of our 3D Scanning process. Our scanner can be configured to produce high resolution photorealistic scans in about 5 minutes, or it can produce high-speed low-resolution scans at 10 to 60 Hz (we haven't benchmarked high-speed yet). We will spend the summer developing routines to enable & refine these features.
- Collect feedback from potential users/customers by participating in online 3D communities. We will solicit market feedback by posting downloadable 3D models. The market feedback will help shape our future development.
November 11th, 2013 Comments off
This year's enhancements to the image processing routines in our stereo scanning software has improved processing speed and 3D model accuracy. Comparisons between our current results and those from 9 months ago show that we have reduced the magnitude of one type of geometric error in our 3D scans by a factor of 2 to 4, and we project that future software and hardware enhancements will allow us to cut the noise in half at least 5 more times. Finding/developing a benchmark to clearly reflect these results has been tricky. In the previous post we compared scans by superimposing them on each other and then comparing the non-linearity of flat surfaces. Because each surface should be flat, any deviation from a straight line represents a scanning error. We used standard deviation analysis to determine that our improvements had cut the error in half for this specific test, but that one number doesn't tell the whole story. What other metrics and ratios should we use to judge the quality of the 3D scans that our scanner produces? Until we come up with a more useful metric to quantify the relative quality, we will use human perception to evaluate the quality of scans. The video below shows the results of our last 9 months of software enhancement.