Hello - we have a lot, let's say several hundred to thousands, of gINT project files located on several different network servers. We'd like to compile all of our borehole x/y, some lithology, etc. to a web map for internal use.
I'm realizing now that Professional Plus allows multi-project data storage in SQL, but we're just using Professional. Does anyone have any suggestions as to a method or best practice to access (or export from gINT as a batch somehow) all of our existing gINT gpjs > grab info from the tables > and put into a new standalone database (SQL, PostGIS, etc.)? I'm basically looking for batch/programmatic options to access each of the smaller .gpj and import into separate stand alone database, I apologize if this is apparent somewhere in the literature - and thanks in advance for any advice!
Michael
Hi, I did what you are wanting a good few years ago, except I dumped the data into a single gINT project instead of an external database. I think I did it with around 3 - 4000 gint projects. Does the database system you are going to use allow you to export the Data Structure out to csv or excel (or access for that matter)? If it does then use that as the target for a coorrespondence file, and batch export from gINT.
Answer Verified By: Michael August
@Phil - ok thanks for the offer, I will keep that in mind if we cannot work it out...
@Miles - I guess I'm wondering how difficult it was to batch export from multiple locations, i.e. our gINT project files are contained within many separate job folders across the network, did you have all of your projects stored in one location, or is there a way to search the network in gINT during batch export?
I think we're going to use PostgreSQL for this project and I should be able to export data structure and use a correspondence file. The part I'm trying to wrap my head around is the automation of the "finding" and merging of all of our projects across the network. Did you run into any trouble merging different versions of gINT projects?
Thanks again for the help!
Hi Michael,
What I did was (and I have a good few terrabytes of free hard drive space on my workstation!) I ran a search in windows explorer for "*.gpj" on our server (we too have our gINT projects stored in separate job folders) and then just copied all the files that the search threw up to a folder on my hard drives. Once I had them all in one place, I set up a Text Table Report in gINT that reported the Job No., POINTID, POINT.HOLE_NATE & NATN but only where the NATE & NATN fields had data. I then output this, pointing it at the copied files in the folder on my hard drives. This gives you a list of all the projects and points that have Eastings and Northings (obviously, any jobs that don't aren't much use for plotting on a map). I went through and deleted all gINT project files that weren't on the list.
In my case I did the map plotting on Google Earth from gINT, so I just created a new data template with a modified HOLE table that had the job number prefixing each hole, and imported all the relevant data from all the remaining projects in my folder, using a correspondence file that added the job number to everything, leaving you with a single, very large gINT project containing all the holes with coordinates. This is NOT something to be tried on a normal PC, it will probably kill it :-)
Hope the above was of some help. If you have any questions etc drop me a line on miles"at"gintdev.co.uk
Regards
Miles
We do the same every year by combining all the gINT projects into one file using the batch import function from gINT Professional. Then creating a simple Correspondence file during the import which prefixes the job number followed by the exploratory hole location. Then export it to CSV and able to import it to various GIS Softwares.
Regards,
Aly Abdelaziz Aly
Technical Manager / gINT Manager
Al Hai & Al Mukaddam for Geotechnical Works LLC
P. O. Box 60462 | Dubai | U.A.E. | Office Tel: +971 (4) 8854854 | Office Fax: +971 (4) 8854853 | Lab Tel: +971 (4) 8854771 | Lab Fax: +971 (4) 8854772 | Mobile: +971 (50) 6450510 | Email: ali@ahamgeo.com
This is great, I've been looking into way to consolidate the gINT databases that we've accumulated over the years. How did you guys overcome projects that were in different projections?
gINT Professional Plus will accommodate different coordinate systems between projects. See this link for more information.
One of the points relevant to your question in that article is the following:
"When outputting a fence diagram or site map from multiple projects in an Enterprise database, if the coordinate systems are different, the program will determine the UTM zone at the center of all the boreholes and project all the coordinates to that zone. This ensures that the relative positions of the boreholes are as accurate as possible. This facility is available in Enterprise mode [gINT Professional Plus] only."
The article also describes the gINT Pro Plus Coordinate Conversion tools, which are useful for mapping purposes when you have different projections.
If you don't have Professional Plus and prefer the approach described above involving consolidation of multiple GPJ files, you could manually convert coordinates to WGS 84 Lat/Long. This forum thread discusses workflows for that.
(If you're not familiar, gINT Professional Plus allows you to store data from all your projects in a SQL Server Database instead of separate Project Files. For more information, check out the February gINT SIG (Special Interest Group) workshop on best practices for moving to gINT Professional Plus. You can find a recording on the Bentley LearnSERVER under the gINT Special Interest Group Learning Path.)