Alfredo Covaleda,
Bogota, Colombia
Stephen Guerin,
Santa Fe, New Mexico, USA
James A. Trostle,
Trinity College, Hartford, Connecticut, USA
Susan Smith, editor of GISWeekly Review, reviews a new book from ESRI Press on GIS portals. See review below or check out Spatial Portals: Gateways to Geographic Information ============================== Spatial Portals Book Review By Susan Smith
A new book out from ESRI Press called Spatial Portals: Gateways to Geographic Information by Winnie Tang, founder and CEO of ESRI China (Hong Kong) and Japan-based independent consultant Jan Selwood, offers a comprehensive look at spatial portals from an ESRI point of view, using as examples spatial portals developed with ArcExplorer Web Services, Geography Network software, ArcIMS for internet mapping, and ArcSDE for data management.
Spatial portals are described in this book as Web sites that either “assemble many online resources and links into a single location to form easy-to-use products or provide search tools that help users find information on the Web.” Of course, portals such as America Online and CompuServe have provided this type of single source for resources for a long time; Google and Yahoo! and MSN have provided search tools that are now in direct competition with ESRI in some areas.
Three types of spatial portals are currently in use: application portals, catalog portals and enterprise portals.
Catalog portals maintain indexes or catalogs of available information services. Generally service providers can add metadata to the portal and it is then organized into a catalog that allows users to access information.
Application portals are for the well-defined audience or those with specific requirements and generally combine information services into a Web-based mapping package that is task-specific. They usually include dedicated application and data servers and provide services that are more complex than catalog servers.
The enterprise spatial portal is designed to integrate spatial data with business enterprise solutions. Initially they were originated by Oracle and SAP, and their focus was on enterprise wide resource planning, office automation and document management. Now they also encompass spatial information.
Spatial portals are often the spatial data infrastructure (SDI) front end to a network of information, and although SDI has been used by organizations and governments since the 90s to organize, access and search information, spatial portals allow faster access to information than ever before.
What we've seen repeatedly in the past couple of years has been the proliferation of spatial portals after a natural or other type of disaster, such as the Indian Ocean tsunami or Hurricane Katrina. An example is the Pacific Disaster Center's portal launched within hours of the news of the tsunami, providing news, data and links to mapping services related to the disaster. Also the PDC launched a Map Viewer and an underlying map service.
Besides this portal, the PDC hosts a number of permanent portals to help improve coordination of efforts and access to information. Disaster and resource managers and others can register services such as online or downloadable datasets with the Asia Pacific Natural Hazards Information Network (APNHIN) so that governments, planners and non-governmental organizations can search for and access information pertinent to hazard evaluation and response planning.
Hurricane Katrina occurred after this book's publication so the myriad of spatial portals developed to aid in response and recovery for that disaster are not covered here.
Some time is spent on Geospatial One-Stop, whose mantra is “two clicks to content.” The One Stop program, launched in December 2002, is an intergovernmental project managed by the Department of the Interior in support of the President's Initiative for E-government. Geospatial One Stop builds upon its partnership with the Federal Geographic Data Committee (FGDC) to provide easy to use geospatial information access to the public and government, drawing from databases and directories across the nation.
In 2003, the Norwegian government endorsed Norway Digital, a plan to develop a spatial data infrastructure with spatial portals at its heart. Norway is a land of contrasts – 11 percent of the total population live in Oslo, the nation's capital, while 45 percent live in provinces located in 100 kilometers of the city, concentrating population in the southeast. There are fewer than six people per square kilometer in some municipalities.
While national mapping programs all have their own challenges, Norway has addressed its problem of mapping remote regions by building partnerships between public agencies and private industry. Although it is focused on government agencies, Norway Digital embodies the building of a national geospatial framework that is composed of multiple spatial portals that can be used by participating members to build their own sites and services. A new NMA portal is geoNorge, which adds search functionality and indexing as well as hosts topographic map services across the whole framework.
The South Carolina Department of Health and Environment Control (DHEC) has developed a portal called the South Carolina Community Assessment Network (SCAN) South Carolina Community Assessment Network (SCAN) that provides a real -time, interactive gateway to DHEC's databases. Users can use it to integrate and analyze health data with other data from state, local and federal agencies and provides efficient access to public health information.
Each of the case studies found in the book are interesting examples of what has been accomplished using spatial portals. The book is described by one reader as a “true portal on spatial portals.” Whether or not this is the case, the book is a valuable resource showing just what spatial portals are capable of and how they are changing the way we view, manage, sort, find, share and use geographic information. Spatial Portals: Gateways to Geographic Information, by Winnie Tang and Jan Selwood, 176 pages ESRI Press ISBN 1-58948-131-3
Interesting announcement from Yahoo Maps this week. Seems as though Google, Yahoo and Amazon (with it's A9 entry) are starting to look like three NASCAR competitors on the backstretch of the lap before the finish line. Here's the latest from Yahoo: ==========================
In June of this year, we gave developers the ability to overlay geographic data on a Yahoo! Map. Since then, we've seen a lot of terrific maps mash-ups. But you wanted more. You wanted the ability to embed Yahoo! Maps on your own Web site. You wanted to programmatically convert addresses into geocoded longitude/latitude pairs. You wanted more data feeds, such as highway traffic and local data, to plot on a map. But most importantly, you wanted a user experience that's better than any online mapping product out there.
Today we build on the success of the Simple Maps API by adding several new APIs for Yahoo! Maps. These products enable developers to use Yahoo! Maps in exciting new ways — including embedding maps on your Web site.
With this release, we are providing:
Of course, the Simple Maps API we released in June is still there, giving developers and non-developers the ability to plot locations on Yahoo! Maps with no programming and no rate limits.
We're giddy with excitement about this release, and we can't wait to see how you use the new APIs. We know there's lot to digest here, so if you have questions, feedback, or just want to show off what you've done, please join us in the yws-maps group.
Jeffrey McManus Director, Yahoo! Developer Network
Much of what we've seen and read about the U.S. government's plan to stave off a pandemic bird flu suggests that everyone — EVERYONE — needs to be vaccinated. Even if we knew what is necessary to produce an appropriate vaccination, producing 280 million doses is not a trivial task. But there may be another strategy that journalists should be asking about: Isolation strategies and then vaccination of a limited number of persons in a society. These strategies have been developed as a result of work by the simulation modeling folks, especially Josh Epstein at The Brookings Institute. See — and be sure to click on the videos: Toward a Containment Strategy for Smallpox Bioterror: An Individual-Based Computational Approach
Joshua M. Epstein, Derek A. T. Cummings, Shubha Chakravarty,Ramesh M. Singa, and Donald S. Burke CSED Working Paper No. 31 December 2002
For those interested in the forensic process — and in this case, computer forensics — be sure to check out this fine, fine piece of digital detective work by Mark Russinovich, a computer security expert with Sysinternals. He discovered evidence of a “rootkit” on his Windows PC.
We don't think journalists need to know how to DO this kind of deep-diving probing, but we should be aware that it is possible and, broadly speaking, the methods if only to know the appropriate search terms. Through heroic forensic work, he traced the code to First 4 Internet, a British provider of copy-restriction technology that has a deal with Sony to put digital rights management on its CDs. It turns out Russinovich was infected with the software when he played the Sony BMG CD Get Right With the Man by the Van Zant brothers.
Here's WIRED Magazine's take on the story, “The Cover-Up Is the Crime“
And here's what Dan Gillmor had to say about it, with additional links.
Another example of how journalists can learn from other disciplines comes to the surface in the form of an LA Press Club meeting Nov. 9. “Digging deep: What reporters can learn from and about private investigators,” is the topic, and the panel of speakers, though large, seems rich with potential.
Here at the IAJ we also value the well done blog, “PI News Link,” run by Tamara Thompson. Check it out; enter it in your blog harvester.
He has posted some handouts at dicar.org/global2005 or
Friday's highlights from the conference in Amsterdam…. Henk van Ess has given two fine training sessions yesterday and this morning. The first: Training 02: Forensic surfing (Thursday 14.00 – 15.15) How can you figure out the reliability of a website – even without opening the site? How do you find the owner of a web site? How can you see how old a page is, even if it doesn't say 'Page last updated at..'? How do you find the author of a Word document? Welcome to the world of forensic surfing. Extra: CD-ROM with the course 'Internet Detective' for all participants. Watch the HTML version at www.searchbistro.com/forensic.htm The second session: Hacking with Google (Friday 9.30 – 10.45)
“People make mistakes. They put sensitive data on servers. They forget to remove delicate material. They leave directories open with hidden files. Learn how to use Google in a different way. The best search techniques for finding secret documents from governments, institutions and companies. Open them with the right questions. Henk van Ess (AD, Netherlands) teaches you what sort of words you have to type, which special syntax you have to use and how you should interpret the answers. Note: this training will teach you how to find material that shouldn't be on the web. It doesn't teach you how to hack into systems.” This presentation can be viewed at www.searchbistro.com/hack.htm There is a companion book – The Google Hacker’s Guide: Understanding and Defending Against the Google Hacker by Johnny Long (johnny@ihackstuff.com) — partial section at www.searchbistro.com/googlehacks.pdf
Profs. David Kleinbaum and Nancy Barker will present theironline short course “Analysis of Epidemiologic Data” Oct.14 – Nov. 11 at statistics.com. Topics covered in thecourse include: simple analysis of 2×2 tables, control ofextraneous variables (including an introduction to logisticregression), stratified analysis, and matching.
David Kleinbaum, a professor at Emory University's RollinsSchool of Public Health, is internationally known for histextbooks in statistical and epidemiologic methods and asan outstanding teacher. He is the author of “ActiveEpi”and “Epidemiologic Research- Principles and QuantitativeMethods” and has also taught over 150 short courses overthe past 30 years throughout the world.
Nancy Barker is a consulting biostatistician and a co-author of the “ActivEpi Companion Text,” and has over 10years of experience teaching short courses in epidemiologyand biostatistics at Emory University and the Centers forDisease Control and Prevention.
As with all online courses at statistics.com, there are noset hours when you must be online, and you can interactwith the instructor over a period of 4 weeks via a privatediscussion board. We estimate you will need about 10 hoursper week.
Registration: $399 ($299 academic)http://www.statistics.com/content/courses/epi3/index.html
Peter Brucepbruce@statistics.com
P.S. Also coming up – “Clinical Trial Design” Oct. 21 –Nov. 18 with Dr Vance Berger.statistics.com612 N. Jackson St.Arlington, VA 22201USA
Another piece in The Guardian this week (some of the Brit papers are a very good read) discusses how Tesco harvests — and then replants — customer data. This is of interest because Tesco, a British company, is hankering after the U.S. grocery chain, Albertson´s. See “Tesco stocks up on inside knowledge of shoppers´ lives´´ below and “ Profile of an upmarket C10 deserter“ sidebar.
· Crucible database is exhaustive – and secret · Government bodies are tapped for information
Guardian
The company refuses to reveal the information it holds, yet Tesco is selling access to this database to other big consumer groups, such as Sky, Orange and Gillette. “It contains details of every consumer in the UK at their home address across a range of demographic, socio-economic and lifestyle characteristics,” says the marketing blurb of dunnhumby, the Tesco subsidiary in question. It has “added intelligent profiling and targeting” to its data through a software system called Zodiac. This profiling can rank your enthusiasm for promotions, your brand loyalty, whether you are a “creature of habit” and when you prefer to shop. As the blurb puts it: “The list is endless if you know what you are looking for.”
This publicity material was, until recently, available on the website of dunnhumby, but now appears less forthcoming. Attempts by a number of Guardian reporters to retrieve their own personal information under the Data Protection Act led to a four month battle; the request was ultimately denied so the Guardian has appealed to the Information Commissioner. Tesco has provided some personal data held by Clubcard, the loyalty scheme that monitors members' shopping and which has been credited with fuelling the supermarket group's astronomical growth in the past decade.
But as far as Crucible is concerned, the company admits it has “put great effort into designing our services” so information is classed in a way that circumvents disclosure provisions in the Data Protection Act. Clues about the content of dunnhumby's database have appeared in the company's marketing literature. Crucible, it says, is a “massive pool” of consumer data. “In the perfect world, we would know everything we need to know about consumers. We would have a complete picture: attitudes, behaviour, lifestyle. In reality, we never know as much as we would like.” But Crucible, it suggests, has got much further than rival systems by pooling data from several sources and then using the vast Clubcard data pool to profile customers.
Together, Crucible and Zodiac can generate a map of how an individual thinks, works and, more importantly, shops. The map classifies consumers across 10 categories: wealth, promotions, travel, charities, green, time poor, credit, living style, creature of habit and adventurous.
A “Mrs Pumpkin” is cited: she makes pennies work when she shops, mostly uses cash, has a steady repertoire of products but experiments with the new, shops at various times, spends a little more on eco-friendly items, is involved with charitable giving, is rarely away and likes promotions for things she buys.
How does Tesco get the information? Clubcard is used to target promotions at particular cardholders. But Crucible is separate and Tesco insists that while loyalty scheme data is used by Crucible it does so anonymously rather than a house-by-house, name-by-name basis.
Dunnhumby's chairman, Clive Humby, offers a few more clues. Companies such as Experian, Claritas and Equifax have databases on individuals and Crucible collects from them all. Any questionnaire you may have completed, any reader offers you responded to, are bought to build up a picture of attitudes and habits. Crucible also trawls the electoral roll, collecting names, ages and housing information. It uses data from the Land Registry, Office for National Statistics and other bodies to generate a profile of the area you live in. Zodiac is employed to provide a more detailed profile. The combination is valuable to many consumer goods firms: dunnhumby generated profits of £4m on sales of £28m in the last year for which accounts are available. Some £12m of business was done directly with Tesco.
Mr Humby and Edwina Dunn founded dunnhumby. The two have a reputation as shrewd operators in the marketing industry and still own shares in the firm alongside Tesco's majority stake. How the supermarket group and other customers use the data is less clear. One former employee involved in the company's marketing told the Guardian that it can be used to decide how to target offers to individuals or where to open new stores.
A Tesco spokesman said last night: “All work carried out by dunnhumby is regulated by the Data Protection Act and the Direct Marketing Association Code of Practice.” But, as the supermarket unveils yet another set of sparkling half-year figures today, one thing is clear: while past success may have been built on the company knowing its customers, Tesco plans to secure its future by knowing everyone else's customers as well.
Profile of an upmarket C10 deserter
When it comes to my personal information, I'm a natural paranoid. So when signing up for a Tesco Clubcard to get those cashback vouchers and offers, I made a point of providing as little information as the application would allow.
No matter. According to Tesco's disclosures under the Data Protection Act (DPA), in the year my card was in use the supermarket managed to build a substantial – if rather wayward – portrait of this reluctant shopper's habits. A formal DPA request, followed by numerous letters to and fro, a terse telephone conversation and finally, a fax explaining that, yes, this information would be used in a journalistic exercise, finally produced two sides of information.
Apparently, I'm a gal who hankers after “finer foods”- indeed, a “natural chef”, though friends tell me this probably has more to do with my tendency to cook with natural ingredients than any signs of being a budding Nigella. I am, Tesco determines, “upmarket” – a reference, I suspect, to my habit of buying organic food (Green & Blacks mint chocolate being a particular favourite).
The database defines me through the past four years, placing me in the mysterious “C10” category for 2003, having been an “H13” a year earlier – whatever that means. My “family type” is “other,” though alternative social options are not listed. Most importantly for the supermarket, I just don't spend as much as I could there. Under “share of spend” with Tesco I am deemed to have “potential”.
My household carries a “reference number”, the date of my last visit, with branches used in the past. It says whether I have used Clubcard vouchers and correctly states I do not want my personal information to be passed to other parts of the “Tesco Group”. There is no information as to whether I am diabetic, teetotal or have a special diet.
Five slots describe my “shopping habits”, each carries the words “Not shopped in last eight weeks”. Clearly, I'm a Tesco deserter and a prime candidate for those £10-off vouchers that have been dropping through the letter box of late.
· To learn how to get your personal information under the Data Protection Act, see www.guardian.co.uk/foi
The UK paper The Guardian carries a couple interesting pieces this week on the British company, The Press Association, or as it is know now, the PA Group. Essentially, it demonstrates that investment in creative people who can leverage digital technology can make money.
See ´´The new heart of British journalism´´ and “Service used by every paper makes only 1% of the money ´´
The new heart of British journalism
A sleepy Yorkshire town has become the hub of an international publishing operation
Martin WainwrightTuesday September 20, 2005
Twice now, extraordinary things have happened to the sleepy market town of Howden – little more than a village on the rich, flat land where the river Humber is joined by the Yorkshire Ouse. The first time, in the 1920s when the local airfield became the centre of Britain's airship industry, ended abruptly with the loss of the R101 (and the then air minister) in a storm over northern France. The second time is now, and it shows no sign of collapsing at all.
Quietly over a decade, Howden has become one of the biggest centres of journalism in the country. More than 650 staff of the Press Association – well over double the organisation's workforce in London – occupy buildings scattered round the quaint streets, as if an Oxbridge college had dropped in. Editorial trainees are in the Bishop's Manor, a medieval roost with jumbo plasma TV screens in the fireplaces where the Bishops of Durham used to warm up after trekking down from the north-east. Guests from London stay in a redbrick Georgian manor house which looks like something out of Jane Austen.
The high command of PA Sport has the vast, curving top floor of a purpose-built office block which replaced the town's redundant police station and magistrates' court two years ago. From here, among scores of other sports information services, Premier League goals and match analysis are texted live to mobile phones all over the world.
Howden is the main laboratory for PA's expansion from a comprehensive and reliable news-wire into the structural support for newspapers, websites, television, radio and magazines. The guts of the service is produced elsewhere, by reporters at news events, parliament or sports fixtures, but the processing and ever more imaginative marketing go on in Yorkshire.
Tony Watson, PA's editorial director, a multiple award-winner and former editor of the Yorkshire Post, relishes the innovation. Outside his office on the ground floor, reporters' material is slimmed into Teletext bulletins (“An excellent subediting exercise,” he says. “The contents have to have exactly the right wordage to fill a line across the screen.”) On the next floor up, the same data is repackaged for listings and, with extra content, for breaking-news sections on websites, including the Guardian's. On the top floor it gets reprocessed again for sport.
Another section turns it into mini-bulletins for mobiles, text-only or with pictures. There are initiatives to expand it into digital TV, with a studio just opened and a specialist journalists' training course starting next month. Although PA has always been, and remains, modestly anonymous, its Howden super-office is starting to publish on a scale most editors must envy.
Touring the main building, Watson points out a wall pinned with national and international news pages from British local newspapers. Copy has always been provided for these by PA but now staff at Howden offer story choice and complete page layout too. A couple of those magazines dished out by rail companies are produced here with advertising and printing subcontracted to regional newspaper customers of PA. A canny use of partnerships has been part of the agency's growth. The editorial centre grew out of joint working with now vanished Westminster Press. PA Weather, which now sells its meteorology to road-gritting departments as well as the media, has just taken over the other, Dutch half of the joint operation.
Howden is now full up, says Watson, whose colleague Chris Buckley, managing director of PA Sport, takes over half the middle floor on Saturdays, when football needs 70 extra staff and the listings terminals are briefly unoccupied. There has been criticism about PA pay rates – this month the National Union of Journalists published a survey showing levels as low as £12,000 a year at Howden. But the size of the operation is buoying the flagging local economy, and vacancies are quickly filled.
And now there is India. By November, 50 staff will be backing up the Yorkshire operation in offices in Mangalore, on the south-west coast of India, which are also designed to be a jumping off point for further news and sport packaging overseas. “There's tremendous interest in British sport in Asia,” says Watson, describing automated systems in Howden which text or email results, as they happen, in Cantonese, Thai, Mandarin and many other languages. “But there's also a growing number of fixtures locally, which we can handle either for other markets or for the countries involved.”
Two recent deals see PA distributing German sports results in Germany and – from this autumn – selling South African premier league reports and results within South Africa. Mr Buckley says: “They're holding the World Cup there in five years' time and Fifa has recommended the data-processing system as a model for the rest of Africa.”
After the R101 tragedy in 1930, there was gloom in Howden when glamorous airship designers stopped coming from London. Today, the “Howden Flyer”, a direct, two-hour train service from London which stops at the town six times a day to drop off largely PA clients, is only going to get busier.