Power Civil: LIDAR thinning

This is a continuation of an earlier post wherein I described problems with converting a large LIDAR dataset to DTM in Power Civil. I have the points file clipped to the area of interest and have sucessfully built a DTM. Now I want to thin the data to improve performance. The clipped data file contains almost 5 million points and is about 166 MB in size. When I run the Filter XYZ tool in LIDAR tools I get a memory allocation error. I have tried both the TILE and TIN filter options and have used the recommended settings in the help system.

I have 2 GB of memory on my Dual Core 1.6 GHZ XEON machine. Any suggestions on alternatives or troubleshooting techniques?

Power Civil XM ver. 08.09.06.30

  • I decided to have another try at generating contours from the TIN file and am now able to load them sucessfully. I suspect that during my efforts to find a solution to my task I was loading and unloading other applications that may have left residue in my main memory and caused the allocation problems. Today I sucessfully generated 2' and 10' contours from my UN-thinned TIN consisting of 4.9 million points...impressive!

    Neil Wilson (aka Neilw)

    Power Civil v8i 08.11.07.245

    AutoCAD Civil 3D 2018

  • Due to the performance problems caused by the large amount of data we have had to clip our study area even more. I  was able to trim the data down to about 1 million points and have the TIN built and ported to my Land Desktop Project so I am good to go for now and won't be needing more assistance. However if you still want the data let me know and I will upload to the FTP. Even though I could build the TIN using all 2.5 million points, Power Civil ran out of memory when loading the contours. I was loading 10' and 2' intervals in order to compare with the contours provided with the LIDAR data. Being able to process the data into a TIN is only part of the battle.

    Neil Wilson (aka Neilw)

    Power Civil v8i 08.11.07.245

    AutoCAD Civil 3D 2018

  • In the mean time, here is a suggestion that perhaps will help get you underway:

    1. You have already used the LIDAR tools to clip to your desired area.  Instead of one large clipped area of 2.5 million points, clip to multiple smaller areas.
    2. Then filter each of these smaller areas
    3. Then merge the smaller areas into a complete TIN.

     Not the most efficient method, sure, but if you are facing a deadline. 

    Note: Pay special attention to the edges where the multiple small TINs merge back together to check for oddities after they are merged.

     

    Robert Garrett
    Senior Product Engineer
    Bentley Systems Inc.



  • Good Morning Neil

    The 30 million number apprently comes from our help file.  (Thanks Mike).  My experience still indicates that your computer is choking on the size of the data.  But I am investigating.  I have a LIDAR test set, but if you can send me a link to your your LIDAR file then I will look at yours.  Or post it at ftp://ftp.bentley.com/pub/incoming and send me an email when it arrives.

    Robert Garrett
    Senior Product Engineer
    Bentley Systems Inc.



  • I did thin the data as far as I dared to. Z filter was 1.0 which gave marginal results. Actually Power Civil is handling it pretty well considering the size. The 30 million points info came from various inside sources. Not to say that is an official claim, but I believe it is in a blog or forum somewhere as well.

    I managed to get the data into my other applications by using the same thinned XYZ file so the XML export is no longer necessary at this time.

    It looks like we are going to need to move to a 64 bit OS soon with data like this becoming more and more common.

    Neil Wilson (aka Neilw)

    Power Civil v8i 08.11.07.245

    AutoCAD Civil 3D 2018