USGIN Community Homepage

Welcome to the USGIN Community page! This is a great place to start getting involved in the USGIN project.

Community Tags

Latest Group Posts

Using and Customizing Leaflet

Ryan Clark's picture
Ryan Clark 03/14/2012 - 1:52pm | Comments 0

Leaflet is a simple javascript framework for building web-mapping applications. In thier words:

Leaflet is a modern, lightweight open-source JavaScript library for mobile-friendly interactive maps. It is developed by CloudMade to form the core of its next generation JavaScript API. Weighing just about 21kb of gzipped JS code, it still has all the features you will ever need for your web mapping needs, while providing a fast, smooth, pleasant user experience.

It is built from the ground up to work efficiently and smoothly on both desktop and mobile platforms like iOS and Android, utilizing cutting-edge technologies included in HTML5 and CSS3. The focus is on usability, performance, small size, A-grade browser support, flexibility and an easy-to-use API. The OOP-based code of the library is designed to be modular, extensible and very easy to understand.

When you're choosing a javascript framework to build your web-mapping application, you have a myriad of options. Why choose Leaflet? Well this is why I liked it:

» Read more Making Web Maps

JSON template for a 'complete' metadata record

srichardAzgs's picture
srichardAzgs 12/12/2011 - 10:44pm | Comments 0

Incorporates concepts from ISO 19115, 19115-1, 19119, FGDC, 19110, and FRBR along with some additional stuff like recording the lineage of the metadata record, which is useful in a metadata harvesting federated system. Builds on the conceputal model presented in a previous discussion here.

This is an experiment to see what it would look like, trying to bring in just about any metadata property from those various specs... Lot's of comments in line.

The JSON is not perfect -- I'm a newbie.

» Read more Metadata interest group

Machine actionable links-- metadata, linked data, contexts...

srichardAzgs's picture
srichardAzgs 12/12/2011 - 9:33pm | Comments 0

I spent some time researching this issue in the context of some other projects I've been following or involved in  (OWS context Standards Working Group, energy industry ISO19115 metadata profile, and USGS CGI Web Application Integration Framework group). I would like to see this considered in a larger context to come up with a solution that can be used in these various contexts, because it's essentially the same problem.
Here' s the gist of the proposal for link attributes outlined in the attached doc:

href -- the link URL

type -- MIME type of response. Specifies encoding and optionally the native software application environment. We're sort of stuck with this because of existing usage. One big question is how much of serviceType, puprpose, and outputScheme it makes sense to conflate in the MIME type. I favor keeping the MIME type limited to low-level file formatting--to answer the question 'what software can read this file in a useful way' Understanding the content and intention of a document or the interface to a service should be specified by separate properties.

» Read more Metadata interest group

Scenario for a community metadata editor

srichardAzgs's picture
srichardAzgs 12/12/2011 - 1:13pm | Comments 0

Introduction

This is a scenario for a generic metadata edit tool, intended for brainstorming development of a community component that is transportable and reusable. Use of a standardized tool for editing metadata will reduce the cost of entry into the metadata game by reducing training and increasing productivity, and should help improve the quality and consistency of metadata.  The attached word document has the same text. Please add any other features or requirements that would be useful.

Here is a run down of some functionality.

The Scenario

Start: User opens the editor application.

» Read more Metadata interest group

AGU Fall 2011 -- 2 posters: GeoSciML v3 release, and USGIN metadata

srichardAzgs's picture
srichardAzgs 12/12/2011 - 11:35am | Comments 0

GeoSciML v3 'release' announcement poster

USGIN metadata poster

» Read more Presentations and Posters

State Geothermal Data and the US Geoscience Information Network; SDSC Summer institute in Geoinformatics

srichardAzgs's picture
srichardAzgs 12/12/2011 - 8:04am | Comments 0

Outline: Background; Approach: Metadata, Services, Interchange formats; Current status; Architecture and artifacts; Way forward

» Read more Presentations and Posters

GSA national meeting 2011: USGIN Data integration framework

srichardAzgs's picture
srichardAzgs 12/12/2011 - 7:54am | Comments 0

Progress 2010-2011, service inventory, promoting transition to open data and reusuable applications.

» Read more Presentations and Posters

Googley Metadata

Ryan Clark's picture
Ryan Clark 09/28/2011 - 8:47am | Comments 1

We can all agree that search engines like Google have really defined the way that we search for information on the internet. So the question is, why aren't we using Google to search for our geologic datasets? Do we have to do all that formal, structured metadata? What the hell is CSW anyways?

As an experiment, I built a new site: metadata.usgin.org. This site is buit with Node.js, a really cool way to build a web server by running server-side javascript code. Its so easy. Here's my code. So what does it do?

It acts as a proxy server. You ask it for http://metadata.usgin.org/record/a386a4ba-e892-11e0-9e4a-0024e880c1d2, and it reads that file identifier out and issues a CSW GetRecordByID request to a CSW server. The response to that CSW request is an XML document, and nobody (including Google) really cares about that, so the server formats the record as a very simple HTML page.

» Read more Metadata interest group

Really Generic Functional Requirements for Metadata

Ryan Clark's picture
Ryan Clark 09/08/2011 - 1:26pm | Comments 1

We write metadata so that we can search through it to find datasets we're interested in using for some purpose. I've recently started building a map-centric user-interface for doing this that has highlighted some simple functional requirements that metadata should meet in order to be helpful in accomplishing the task.

What I've done here is essentially listed the conceptual elements that seem neccessary in order to make a functional user-interface for searching. This has nothing to do with metadata syntax, just with metadata concepts.

 

» Read more Metadata interest group

Energy Industry Profile of ISO/DIS 19115-1 v1.0 Release Candidate is Available for Public Review

srichardAzgs's picture
srichardAzgs 09/02/2011 - 7:51am | Comments 0

FYI-- this is a draft profile against the upcoming revision of ISO19115 for metadata, scoped to energy industry, but the scope overlaps requirements for USGIN (I've been very active in developing profile and looked after that).  Please have a look at the docs if you're interested in metadata. Given the standards process time lines, it probably won't directly impact us until next year.

steve

******************************************

 

» Read more Metadata interest group

USGIN/NGDS Presentations at ESRI User Conference

Ryan Clark's picture
Ryan Clark 07/14/2011 - 1:53pm | Comments 0

I gave two presentations at the ESRI User conference this year. One was geared mostly towards what we do with metadata in our systems, while the other was more of a broad overview of USGIN and a little bit of NGDS progress report.

» Read more Presentations and Posters

SDE-Trickery and Awesomeness: Data Transformations Behind-The-Scenes

Ryan Clark's picture
Ryan Clark 06/03/2011 - 8:49am | Comments 0

Imagine that you collected geographic data in one schema and you want to provide it in some other schema. For many of us, this only happens pretty much all of the time.

For example, maybe your organization has an enterprise database which stores all the information that you have about recent, active faults. Now you want to provide that data as a WFS service with fields that conform to the ActiveFaults template being used by the AASG Geothermal Data System. Perhaps you store all your geologic map data in such a database and you want to convert it into FeatureClasses that fit into NCGMP09-style geodatabases.

Here's a nice way to convert your data formats in such a way that you only have to do it once. You can continue to make changes to your data just like you always have, and there will always be a featureclass hanging out there in the new schema which conveys the most up-to-date information that you have. The pre-requisites are:

» Read more ArcGIS Server and OGC Services

OGC Services don't work outside local network!

Ryan Clark's picture
Ryan Clark 05/26/2011 - 5:35pm | Comments 0

A commonly overlooked step in the configuration of an ArcGIS Server is that you need to tell the server what its name is to the outside world. You see, on an internal network your computers might have names. As geologists we prefer names like "Eclogite", "Kyanite", "Harzburgite", etc... However, on the internet computers generally have more complicated names. These names are things like "services.azgs.az.gov" or "www.google.com" or "lab.usgin.org".

By default, your ArcGIS Server knows what the computer's internal name is. However, once you want to share your services with people outside that local network, you need to tell the ArcGIS Server how those other people will find it. You do this by editing a file called "rest.config". If you installed IIS and ArcGIS Server in all the default locations, you'll find this file at C:\inetpub\wwwroot\ArcGIS\rest\rest.config.

Look through the file and find all the URLs in it. Make sure that instead of using the computer's internal name, those URLs use the computers external name.

For more information, here are a couple of links:

» Read more ArcGIS Server and OGC Services

Dynamic Content as WFS

Ryan Clark's picture
Ryan Clark 04/28/2011 - 3:57pm | Comments 0

There could be a number of reasons why you'd like to use a database view as a backend for a WFS. Perhaps your data is split across multiple tables and updated regularly. Perhaps the data is in a table without an explicit ESRI-style SHAPE field. That's the case in this example, where the geometry information is stored in a table as UTM coordinates.

» Read more ArcGIS Server and OGC Services

Brief USGIN Overview: WRP GIS Committee Meeting, Mar. 8th, 2011

Ryan Clark's picture
Ryan Clark 03/18/2011 - 11:53am | Comments 0

A brief overview of USGIN.

From WRP Meeting Notes:

III. Geoscience Information Network

» Read more Presentations and Posters

Using jQuery for basic ISO Metadata record form validation

averill.cate 03/17/2011 - 3:06pm | Comments 1

ESRI's Geoportal metadata record editing has some validity checking, but error checking does not occur until after a metadata record form is submitted.  This can be a wasteful process because it involves having the client (the web browser) send a full request to the application server.  If the submitted form has data validity errors then the whole form is transmitted back to the client for editing.  One way to save the use of server resources (e.g., bandwidth) is by using jQuery to monitor information typed in html input boxes and check value validity before submitting the form.  Since, ESRI's Geoportal comes with jQuery already enabled it is relatively to add validity checks.  The first thing to do is create a custom javascript file (e.g. [geoportal_install_dir]/web/geoportal/catalog/js/custom.js).  The contents of my script are:

$(document).ready(function()

{
  $('#mdEditor\\:identification_date').mask('9999-99-99T99:99:99');
  $('#mdEditor\\:general_datestamp').mask('9999-99-99');     

» Read more Geoportal on an Amazon Virtual Machine

Git Setup: Public Repositories, Secure Commits

Ryan Clark's picture
Ryan Clark 03/01/2011 - 4:31pm | Comments 0

I did this primarily based on blog postings at http://scie.nti.st/2007/11/14/hosting-git-repositories-the-easy-and-secure-way, and also http://book.git-scm.com/4_setting_up_a_public_repository.html. See these posts to see what I did pretty much verbatim.

The big configuration difference is that I wanted the git repositories to reside on the elastic-block store, but be accessible in the usual way. So, after installing git and gitosis and adjusting my gitosis-admin repository, I moved all the repostories from /home/git/repositories to /mnt/ebs/git/repositories. A symlink in the /home/git/ directory links to the repositories on the elastic block store, which makes them accessible to the git user as they need to be.

» Read more USGIN Amazon Virtual Server Development

PyGreSQL: This will be useful!

Ryan Clark's picture
Ryan Clark 02/03/2011 - 9:03pm | Comments 0

PyGreSQL is a python library that allows you to write python code to interact with a PostgreSQL database. I can see some utility here if I start wanting to write Django methods that do things like create views of some of my tables.

May be useful in not too long! Don't forget about it!

Documentation: http://pygresql.org/pg.html

Installation:

sudo apt-get install python-pygresql

Use:

» Read more Using Django for USGIN

Postgres COPY for CSV importing

Ryan Clark's picture
Ryan Clark 02/02/2011 - 2:55pm | Comments 0

Working on some integration between Geoserver, Django and NCGMP geodatabases, I often need to use PostgreSQL's COPY command to import data from CSV files into PostgreSQL. Here are some tips:

» Read more Using Django for USGIN

URI Redirection Engine (with pictures!)

Ryan Clark's picture
Ryan Clark 01/24/2011 - 2:19pm | Comments 0

Here are a few screenshots to give a taste of what it is like to use our new Django app to manage a set of URI redirections:

Administration Overview:

For any URI-Scheme: Basically, the Django app allows you to control a listing of MIME Media Types, and Rewrite rules.

generic admin page

USGIN URI-Scheme: The same basic structure, but the USGIN-specific app allows you to control a listing of Name Authorities and Resource Types, as described in this post.

Usgin scheme admin

 

Listing of Rewrite Rules: A nice overview of what rewrite rules you have in place, and a mechanism for searching for the one you might need to adjust.

rule list

 

Creation of a Rewrite Rule:

» Read more Using Django for USGIN
Related Community Groups
CSW Debug Blog | 17 Posts | Join
A group blog to discuss metadata Catalog Service for the Web (CSW) implementation experiences
Building a GeoSciML WFS Server | 11 Posts | Join
Development, testing and implementation of a WFS service that returns GeoSciML documents
ETL Debug Blog | 12 Posts | Join
A group blog on implementing and debugging Extract-Transform-Load (ETL) efforts.
Presentations and Posters | 12 Posts | Join
Post your posters and presentations related to USGIN topics.
Metadata interest group | 13 Posts | Join
group for general posting on metadata content, standards, tools
USGIN Amazon Virtual Server Development | 18 Posts | Invite only
Documenting the process of development of a Web Server in the Amazon EC2 environment. Software installations tailored to the requirements for USGIN
GeoNetwork configuration and development | 7 Posts | Join
Discussion on GeoNetwork setup, configuration, and development.
Student Projects | 0 Posts | Join
Discussion of student projects related to USGIN
Drupal Development | 6 Posts | Join
All about bending Drupal to your needs
Geoportal on an Amazon Virtual Machine | 3 Posts | Closed
Installation, configuration, etc.
Using Django for USGIN | 7 Posts | Request membership
Thought and ideas about using Django to accomplish USGIN-related... things.
ArcGIS Server and OGC Services | 3 Posts | Join
Tips on using ArcGIS Server to provide OGC web services
Content model discussion | 0 Posts | Request membership
Community site for comments on development of content models and encoding for information intechange
Making Web Maps | 2 Posts | Request membership
For information about the myriad of mechanisms for showing service data on a web page.
Troubleshooting Web Service Deployment - Blog | 5 Posts | Join
This blog is for documenting our group's experiences with web service deployment.
Best Practices for USGIN Web Service Hosting | 10 Posts | Join
Tips, techniques, and frequently asked questions for hosting AASG Geothermal Data Web Map Services and Web Feature Services
Hub Disaster Recovery | 0 Posts | Request membership
Discussions around how to harden a distributed federated system against disaster; setting up a system to mirror hub VMs at other hubs.