2012: A New Year for ShipIndex

2012 will be a new and different year for ShipIndex.org, on many levels. We (I; more on that in a bit) are/am changing the direction in a bunch of different ways. I intend to spend a number of blog posts spelling out what those changes look like, and how they’ll impact the site on its own.

As some background, the original ShipIndex.org started back in 1999, while I (Peter) worked as a reference librarian at the University of Washington. It was strictly a side project and wasn’t even at its own domain for quite a while. Eventually, I moved it to ShipIndex.org, and didn’t bother (alas) to purchase ShipIndex.com while I was at it. I scanned and OCR’d the indexes to several dozen important books in maritime history, and put them on the web. I kept working at it until I had about 100,000 citations online, which I thought was a pretty cool number of citations.

The site wasn’t used much, though I didn’t have a good way of tracking that, such as it was. It wasn’t very Google friendly, so it was hard for anyone to find. Then, more importantly, I started another company with my brothers and a high school friend. As that company took off, I had less and less time to devote to ShipIndex. Some time in 2008 or 2009, after lots of corporate and family changes, I decided I wanted to get back to ShipIndex. After all, the truth is (but don’t tell anyone) I care much more about maritime history than I do about e-journal management. Like I said, don’t tell anyone.

 

In 2009, when I left the other company, I wanted to make ShipIndex much bigger (in terms of its database, really) and turn it into a real company. So I got one brother to help me in creating a much more effective and Google-friendly database with a freemium model that (as of the end of 2011) has nearly 2.3 million citations in the complete database.

Frankly, I’m of two minds about the site right now: I am excited about being able to make maritime history easier to access online. I don’t have any problem charging for access to the premium database, as I believe that, for those who are seeking such information, the work I’ve done in creating this database is incredibly valuable: it saves enormous amounts of time when looking for information on specific ships, and also uncovers paths to previously unknown sources of information. I firmly believe that the small cost for the site uncovers incredible new sources of research, and is well worth it.

On the other hand, growth is slower than I’d like, and uptake among institutions, especially, has been disappointing. I’ve exhibited at many library conferences – an industry I know pretty well – and even at institutions that have maritime programs, and where they say they want to at least trial the product, once we all get home and I contact them, they’re no longer interested.

 

As I said, 2012 will be a new year in many ways. One way will be that I intend to share more information than I have in the past about how I’m trying to grow and improve the company, and the challenges I find I’m facing. This could be a mistake: perhaps some will feel that they don’t want to risk purchasing from a company when they discover that, at this point, there’s really only one person hiding behind the curtain. But perhaps more will recognize what I feel I’m trying to do here, in creating a company that provides a true value to genealogists and historians who want to fill the gaps in their research regarding specific ships.

I guess these entries, like many other things I’ve done so far with ShipIndex, will be an experiment. One great thing about ShipIndex.org so far is that it’s been quite an effective space for trying experiments – I can’t tell you how many different things I’ve tried so far. Some have worked; many others haven’t. I’m doing my best to keep trying different things, tossing out those that don’t work, and keeping (and expanding on) those that do.

I’ll keep you posted, and if you have thoughts or opinions on what’s working and what isn’t, I’d love to hear them, either in the comments below, or in an email to peter(at)shipindex(dot)org.

ShipIndex as a gift

Looking for a last-minute gift for a maritime historian or a genealogist?

Consider a limited-span subscription to ShipIndex.org!

You can give a genealogist three months of access to the premium database for just $25. Or give a historian access to the premium database for six months for $45. Or give a maritime history fanatic access for a year, for just $85! This is a one-time payment, via PayPal (and yes, you can use a credit card through the PayPal site).

To make it happen, send a note to gifts@shipindex.org. We’ll need the following information:

  • The recipient’s email address
  • When you’d like access to begin, and for how long

We’ll create a pdf certificate that you can print out or email to the recipient. It will include a username and a temporary password, plus information on how to access the database.

This can be a great gift, for any occasion — from a holiday or birthday gift to a retirement or ‘Thank You’ recognition.

On the naming of naval vessels

The US Navy has not been very good about how or why it names certain naval vessels. Given today’s political environment, it’s no surprise that even the naming of ships has taken on controversial tones with politicians of all stripes looking for reasons to get up in arms.

A story from San Diego describes Congressional dissent over recent naming decisions. It does seem like the Navy would benefit from a significant review of how names are assigned. The Navy would benefit significantly from some standardization in how names are assigned, such as using a certain type of name for a certain type of vessel. Some additional rules, such as not selecting a person until at least, say, ten years after they’ve passed away, would also be valuable. Each action would take a lot of the politics out of the decision-making, I think. The Navy must name its vessels, and this is an opportunity to recognize its illustrious history, and that of the country itself. If the Navy could do something that would reduce the political backlash it receives for its actions, and improve its own profile in the process, it really ought to consider doing it.

It’s a shame that there’s so little standardization in the naming of US naval vessels, and that politicians use these items to make unnecessary political hay, and that nothing will significantly change, regardless of what happens. But we can always hope.

New and updated content

Lots more new content in the past few weeks. The following resources are new, and include three more Navy Records Society volumes:

In addition, I updated holdings for the following site, which corrected some errors and added lots of new ships:

 

As always, please let me know if you have ideas for content to add. I have enough to keep me busy for the next few years, but I always welcome more suggestions!

More new NRS volumes

I’m plugging away at the Navy Records Society volumes; I’ve added the index to a collection of five volumes today. These are:

So, we’re always getting closer to getting all the NRS content in the database.

Remember that if you see content you’d like me to add, just drop me a line or post a reply here. I’m always interested to hear about new resources to add.

New content added; mostly Navy Records Society volumes

Indexes for the following volumes have been added:

One of my goals is to have the entire set of Navy Records Society volumes included in the database. These volumes are fantastic resources in British naval history. I’m working through them, one at a time. Right now, I think I have about a third or so of them in the premium database, though I’ve been focusing one the ones with the largest number of vessels mentioned in their indexes. (Actually, it’s more than a third, because some volumes have indexes for multiple volumes. I count about 53 actual indexes in the database, out of over 150 volumes published, so I’d guess the total number is closer to 60 or so.) Either way, I’ll keep at it…

Great new review of ShipIndex from Charleston Advisor

I got back from the Charleston Conference last night. I couldn’t stay for the conference, unfortunately, but I did get to attend, and present at, a pre-conference. I didn’t present on ShipIndex (though I did meander aimlessly about it while we were working through some technical difficulties and they needed me to say something – anything! – into the microphone…), but I did get some great ShipIndex news while I was there.

ShipIndex was just reviewed in The Charleston Advisor, a well-known and well-respected source for “Critical Reviews of Web Products for Information Professionals”. The review appears in the October issue, and a copy was distributed to all attendees at the Charleston Conference. ShipIndex got 4-1/2 stars, out of a possible 5, and a very positive review. The summary of the review includes this bit regarding content: “This unique, comprehensive and authoritative database provides a wealth of information about ships. Links to external content pull all of the information about each vessel together in one place. It is a perfect database for vessel research.” Regarding pricing, the reviewer wrote, “The database is so reasonably priced it is ridiculous. You get a lot of information for very little money.”

The full review is available online, but costs a whopping $38. (Of course, the journal itself costs $295 for libraries; $495 for others…) Just trust me – it’s very positive.

To top it all off, Charleston Advisor editors gave ShipIndex the 2011 award for “Best Content“! The citation reads “Everything you ever wanted to know about ships has been aggregated in this one Web site aimed at both researchers and hobbyists. The system is packed with information, has a strong user interface and a visually appealing look. This unique service was created by Peter McCracken, one of the cofounders of Serials Solutions.”

ShipIndex also received a “Recommended” review from Choice this summer (June 2011), which described the site as “a needed research tool for maritime history, [and] useful for academic and special libraries with interested clientele.”

Good feelings all around.

Why indexing matters

I’m a huge fan of indexes, especially to magazines (aka serials, or journals), and it frustrates me quite a bit when I find useful journals that don’t have indexes to them. Here’s why.

The most important reason, most definitely, is because an index makes old issues of a magazine useful and accessible. Generally, a person receives and (hopefully) reads a particular issue. After that, the issue is stored, and eventually recycled.

(Or, perhaps, left at the local public library, if it’s not too old. I’m writing this in my local public library, and I have several recent issues of magazines to drop off in the ‘magazine exchange’ area. But the library has an understandable rule that no magazine left here be more than six months old. If that rule weren’t in place, the magazine area would be overrun with decade-old copies of magazines that no one wants, and the library would be left with the work of sorting through and recycling them all.)

When a library receives a magazine, it gets stored on shelves for a while. In niche areas like maritime history, it will likely eventually be sent to an off-site storage facility, as well. If there’s no guide to finding what’s in a given issue, then there’s basically no chance of finding anything in any particular issue. Consider a library catalog’s entry for, say, American Heritage magazine. Published for over 60 years, its subject coverage is represented in bibliographic data by basically a dozen words – and a third are in French, and two thirds of the remaining ones are duplicated. The only unique English words are “United States History Civilization Periodicals”. But with hundreds of thousands of pages in those 60 years, there’s an enormous wealth of information. Which is why they publish their own index to their magazine. Now, all those hundreds of thousands of pages are accessible to anyone with access to the index.

Maritime history publications would do well to make note of this, and to consider how their data is accessed when it’s more than a few issues old. Organizations that publish quality indexes to their resources, and then make that information as available as possible, are to be commended. As one specific example, consider the San Diego Maritime Museum’s publication, Mains’l Haul. Not only do they publish a current index to their journal, they make that publication freely available online. This is so vitally important, and should be aggressively emulated by every maritime history organization, regardless of their size.

People will be seeking articles from the entire run of Mains’l Haul for decades to come, because they take the time to make an index available to all. While it may cost money to do this (though some institutions are able to take advantage of volunteer indexers), I think it’s easy to see ways that that money will be returned in spades, and for decades to come, as people discover that past articles mention something of interest to them, and publishers of such works can then offer reprint services for those articles at reasonable fees, essentially indefinitely.

If a researcher doesn’t know that a person or a vessel is mentioned in a past article, they will not put that publication to use, and that’s a loss to the publisher, to the article’s author – whose work would be useful but won’t be found – and to history in general.

I’d like to make two additional comments:

First, don’t rely on a commercial abstract and indexing service to do this for you; while it’s great to get one’s content indexed in large databases, they will provide, at best, only a cursory summary of each article. They will not be sufficient for someone seeking a mention of a person, ship, or location that’s mentioned in, but not central to, a given article.

Second, a listing of the articles in an issue is NOT an index. (I’m looking at you.) It’s a list of article titles, and nothing more. While I suppose it’s better than nothing, it misses infinite opportunities to guide researchers to the incredible wealth of information that’s contained in a quality scholarly publication.

Please, magazine publishers: index, Index, INDEX! And if you’re really forward-thinking, make the index available for free, to anyone. Put it online as a pdf, as a searchable database, and as a text file that anyone can download and use elsewhere. What you lose in the cost of creating and distributing the index, you’ll more than make up in revenue from providing reprints and back issues, and (perhaps more importantly) in promoting and displaying the importance, value, and reputation, of the journal in question.

The death of the semantic web

I came across some interesting notes while going through old emails the other day. A message from NISO, the National Information Standards Organization, reported that the semantic web is dead, citing a post on semantico. The semantic web is a concept of presenting data in a structured format, usually as ‘triples’ (I am, absolutely, not an expert – or even that knowledgeable – on this stuff, so don’t quote me too far), so a computer can better understand what each term means.

For example, when a computer sees the word “Magellan”, it just sees a word. It doesn’t know if the word refers to an explorer, to a spacecraft, to a mutual fund, a “progressive metal/rock” band, or something else. By defining, through triples, what one means, the computer can realize that one page is talking about the explorer while another is talking about a mutual fund company.

Such semantic definitions have been used extensively in some subject areas, but not at all in most. And one of the great challenges with it is/was solving problems among the “upper ontology” – that is, the layer that connects concepts in zoology with concepts in art history with concepts in electrical engineering with concepts in maritime history, etc. One field may work hard to define its ontology, but if that schema doesn’t mesh with other ontologies, then the systems aren’t really connected.

So I was interested to read of the effective death of the semantic web, and its replacement by schema.org. Schema.org is a nascent project being put together by representatives from the search teams at Google, Yahoo, and Microsoft’s Bing. It uses microformat HTML tags, added to a page’s markup text, to define what something is. This is done for the benefit of search engines – so a “Magellan” that is marked with the tags

  <div itemscope itemtype="http://schema.org/Person">
    <span itemprop="name">Ferdinand Magellan</span>

is clearly a person, while the Magellan that’s tagged

  <div itemscope itemtype="http://schema.org/Product">
    <span itemprop="name">Fidelity Magellan Fund>/span>

is something you can buy. (Note the differences in the end of each first line; the first is “/Person”, and the second is “/Product”.)

(Also: I defined the Magellan Fund as a ‘product’, because one can buy a share of it, but it might more appropriately be an ‘organization’, since there is a ticker symbol associated with it, and schema.org currently has a “tickerSymbol” attribute for Organizations.)

The current schema.org structure is quite limited, and focuses primarily on people, organizations (especially local businesses), creative works, events, and locations. But it’s certainly extensible, and – if it’s generally adopted, as triples were not – it will clearly expand to other fields.

I’d love to take on extending it to vessels. It’d be pretty easy for us to modify our HTML to include these microtags, and if that helps people find the information they’re seeking, then all the better for all involved. But I’m not sure what the proper levels should be. One doesn’t want to have too many levels in a structure like this, but I think that going straight from “Thing” to “Vessel” might be a bit of a jump. I imagine an intermediate step of, perhaps, “Vehicle”, would be appropriate. Then those with interest in cars, trains, airplanes, bicycles, scooters and lots more, would build out their schemas, while we could start a layout of sailing vessels.

It seems simple, but immediately becomes fairly complex. You could, for instance, split up “Vessel” entries to “HumanPowered”, “WindPowered”, and “MechanicallyPowered”, perhaps, then divide by vessel type – canoe, kayak, paddleboat; sloop, ketch, yawl, schooner, brig, brigantine, barkentine, ship, bark, hermaphrodite brig; paddlewheel steamer, ferryboat, fishing boat, battleship, oceanliner; etc., etc. Is that too much differentiation? How do you define a vessel that’s been re-rigged, from a ship to a bark, for example? How, even, do you make it clear that when you’re talking about a ‘ship,’ you’re talking about a three-masted vessel with square sails on the furthest-aft mast, rather than something that floats and is bigger than a boat?

Lots of other terms could be added or defined over time. When the computer can understand what the term means, rather than just presenting the term to the world, it will make it much easier for individuals to draw understanding and make connections from within large bodies of marked-up data.

It would appear that this system, because it’s fairly easily applied, has a much better chance of success than did the original ‘triples’ approach. I look forward to watching it with interest.

“Trust” and identifiers: two great concepts that concept great together

My two primary areas of interest – library science and maritime history – bumped into each other this week in an interesting way. On the MARHST-L discussion list, there’s been much talk about various vessel identifiers. They haven’t really been called that; participants have been discussing “Official Numbers,” the Mercantile Navy List, and Lloyd’s Numbers, and it has made me think of IMO numbers, Hull Identification numbers, USCG Documentation numbers, naval identifiers (ie, PT-109, CV-42, etc.), and various other vessel identifiers.

On the library side, the latest issue of NISO’s publication, Information Standards Quarterly, is now available, and the entire issue is about identifiers. There’s an article about ISNI, the International Standard Name Identifier; ORCID, the Open Researcher & Contributor ID; the Names Project; the use of SAN, the Standard Address Number, in supply chains; I² and ISNI, and more. I² is the Institutional Identifier; I was very briefly on this working group before I left my previous job.

In that previous job, I used the ISSN, the International Standard Serial Number, a great deal. But for various reasons, it didn’t fill our bill, and we had to create our own unique identifier. We loved and used the ISSN, but it wasn’t quite the complete thing. The identifier we developed was (and, to my knowledge, still is) only used in-house, though it could have had great application elsewhere.

At ShipIndex.org, I believe my future includes developing a new vessel identifier.  (Yes, I know.) I’ve presented on this before, at both library conferences (with slides) and at maritime history conferences, but it hasn’t started to be developed yet. As I see it, when that starts to happen, it’ll be through our website, and it’ll be by individuals who want or need an identifier. People who know more about a specific ship than I do will be able to collate various citations that refer to a single ship, even if its name has changed, and improve the quality of the community’s knowledge about those ships. They’ll also be able to do lots, lots, more, but that’s more for another time.

This isn’t a great description of what I have in mind, and I don’t know if I’ll ever be able to get it built, but I have high hopes for what ShipIndex, with the help of its constituents, can create. I aim to do whatever I can to make it happen. Alas, it’ll take a lot of time and money, and those aren’t yet in abundant supply.

In the NISO publication, Geoff Bilder has a great Op-Ed piece about Trust and Identifiers. I once had a beer with him (I honestly can’t remember if it was in Asheville, NC, or Edinburgh, Scotland. If it was in Edinburgh, I trust it was a scotch, not a beer. I feel certain it was at a UKSG conference [which, possibly, could have placed it in Torquay or Coventry; not just Edinburgh], but at the same time I also think there was discussion of skipping out on the NASIG conference [with someone else, not Geoff] to try and catch UNC and ECU play baseball in the NCAA playoffs. But I digress…) and I probably made a fool of myself. He’s clearly an incredibly smart guy, and I know that what he writes is worth reading, and worth reading closely.

I would like to see ShipIndex.org become the trustworthy source, as described by Geoff, for vessel identifiers. I think it can happen, if only because I’m not sure anyone else is ready to do it. If you’re willing to help, let me know.