SIDEBAR
»
S
I
D
E
B
A
R
«
Big digital doors to GIS
Nov 7th, 2005 by JTJ

Susan Smith, editor of GISWeekly Review, reviews a new book from ESRI Press on GIS portals.  See review below or check out Spatial Portals: Gateways to Geographic Information



==============================

Spatial Portals Book Review
By Susan Smith

A new book out from ESRI Press called Spatial Portals: Gateways to Geographic Information
by Winnie Tang, founder and CEO of ESRI China (Hong Kong) and
Japan-based independent consultant Jan Selwood, offers a comprehensive
look at spatial portals from an ESRI point of view, using as examples
spatial portals developed with ArcExplorer Web Services, Geography
Network software, ArcIMS for internet mapping, and ArcSDE for data
management.

Spatial portals are described in this book as Web sites
that either “assemble many online resources and links into a single
location to form easy-to-use products or provide search tools that help
users find information on the Web.” Of course, portals such as America
Online and CompuServe have provided this type of single source for
resources for a long time; Google and Yahoo! and MSN have provided
search tools that are now in direct competition with ESRI in some
areas.

Three types of spatial portals are currently in use: application portals, catalog portals and enterprise portals.

Catalog portals maintain indexes or catalogs of available
information services. Generally service providers can add metadata to
the portal and it is then organized into a catalog that allows users to
access information.

Application portals are for the well-defined audience or those
with specific requirements and generally combine information services
into a Web-based mapping package that is task-specific. They usually
include dedicated application and data servers and provide services
that are more complex than catalog servers.

The enterprise spatial portal is designed to integrate spatial
data with business enterprise solutions. Initially they were originated
by Oracle and SAP, and their focus was on enterprise wide resource
planning, office automation and document management. Now they also
encompass spatial information.

Spatial portals are often the spatial data infrastructure
(SDI) front end to a network of information, and although SDI has been
used by organizations and governments since the 90s to organize, access
and search information, spatial portals allow faster access to
information than ever before.

What we've seen repeatedly in the past couple of years has
been the proliferation of spatial portals after a natural or other type
of disaster, such as the Indian Ocean tsunami or Hurricane Katrina. An
example is the Pacific Disaster Center's portal
launched within hours of the news of the tsunami, providing news, data
and links to mapping services related to the disaster. Also the PDC
launched a Map Viewer and an underlying map service.

Besides this portal, the PDC hosts a number of permanent portals to
help improve coordination of efforts and access to information.
Disaster and resource managers and others can register services such as
online or downloadable datasets with the Asia Pacific Natural Hazards Information Network
(APNHIN) so that governments, planners and non-governmental
organizations can search for and access information pertinent to hazard
evaluation and response planning.

Hurricane Katrina occurred after this book's publication so
the myriad of spatial portals developed to aid in response and recovery
for that disaster are not covered here.

Some time is spent on Geospatial One-Stop, whose mantra is
“two clicks to content.” The One Stop program, launched in December
2002, is an intergovernmental project managed by the Department of the
Interior in support of the President's Initiative for E-government.
Geospatial One Stop builds upon its partnership with the Federal
Geographic Data Committee (FGDC) to provide easy to use geospatial
information access to the public and government, drawing from databases
and directories across the nation.

In 2003, the Norwegian government endorsed Norway Digital, a
plan to develop a spatial data infrastructure with spatial portals at
its heart. Norway is a land of contrasts – 11 percent of the total
population live in Oslo, the nation's capital, while 45 percent live in
provinces located in 100 kilometers of the city, concentrating
population in the southeast. There are fewer than six people per square
kilometer in some municipalities.

While national mapping programs all have their own challenges,
Norway has addressed its problem of mapping remote regions by building
partnerships between public agencies and private industry. Although it
is focused on government agencies, Norway Digital embodies the building
of a national geospatial framework that is composed of multiple spatial
portals that can be used by participating members to build their own
sites and services. A new NMA portal is
geoNorge, which adds search functionality and indexing as well as hosts topographic map services across the whole framework.

The South Carolina Department of Health and Environment Control (DHEC)
has developed a portal called the South Carolina Community Assessment
Network (SCAN) South Carolina Community Assessment Network (SCAN)
that provides a real -time, interactive gateway to DHEC's databases.
Users can use it to integrate and analyze health data with other data
from state, local and federal agencies and provides efficient access to
public health information.

Each of the case studies found in the book are interesting
examples of what has been accomplished using spatial portals. The book
is described by one reader as a “true portal on spatial portals.”
Whether or not this is the case, the book is a valuable resource
showing just what spatial portals are capable of and how they are
changing the way we view, manage, sort, find, share and use geographic
information.
Spatial Portals: Gateways to Geographic Information, by Winnie Tang and
Jan Selwood, 176 pages
ESRI Press
ISBN 1-58948-131-3





More churning in the mapping API world
Nov 4th, 2005 by JTJ

Interesting
announcement from Yahoo Maps this week.  Seems as though Google,
Yahoo and Amazon (with it's A9 entry) are starting to look like three
NASCAR competitors on the backstretch of the lap before the finish
line.  Here's the latest from Yahoo:


==========================

November 02, 2005

Announcing New Maps APIs

In June of this year, we gave developers the ability to overlay
geographic data on a Yahoo! Map. Since then, we've seen a lot of
terrific maps mash-ups. But you wanted more. You wanted the ability to
embed Yahoo! Maps on your own Web site. You wanted to programmatically
convert addresses into geocoded longitude/latitude pairs. You wanted
more data feeds, such as highway traffic and local data, to plot on a
map. But most importantly, you wanted a user experience that's better
than any online mapping product out there.

Today we build on the success of the Simple Maps API
by adding several new APIs for Yahoo! Maps. These products enable
developers to use Yahoo! Maps in exciting new ways — including
embedding maps on your Web site.

With this release, we are providing:

Of course, the Simple Maps API
we released in June is still there, giving developers and
non-developers the ability to plot locations on Yahoo! Maps with no
programming and no rate limits.

We're giddy with excitement about this release, and we can't wait to
see how you use the new APIs. We know there's lot to digest here, so if
you have questions, feedback, or just want to show off what you've
done, please join us in the yws-maps group.

Jeffrey McManus


Director, Yahoo! Developer Network





Alternative thinking about the Avian Flu worst-case scenario
Nov 4th, 2005 by JTJ

Much
of what we've seen and read about the U.S. government's plan to stave
off a pandemic bird flu suggests that everyone — EVERYONE — needs to
be vaccinated.  Even if we knew what is necessary to produce an
appropriate vaccination, producing 280 million doses is not a trivial
task.




But
there may be another strategy that journalists should be asking about:
Isolation strategies and then vaccination of a limited number of
persons in a society.  These strategies have been developed as a
result of work by the simulation modeling folks, especially Josh Epstein at The Brookings Institute.




See — and be sure to click on the videos:
Toward a Containment Strategy for Smallpox Bioterror:
An Individual-Based Computational Approach

Joshua M. Epstein, Derek A. T. Cummings, Shubha Chakravarty,
Ramesh M. Singa, and Donald S. Burke
CSED Working Paper No. 31
December 2002




Digital detectives
Nov 3rd, 2005 by JTJ

For
those interested in the forensic process — and in this case, computer
forensics — be sure to check out this fine, fine piece of digital
detective work by Mark Russinovich, a computer security expert with
Sysinternals.  He
discovered evidence of a “rootkit” on his Windows PC.

We don't think journalists need to know how to DO this kind of
deep-diving probing, but  we should be aware that it is possible
and, broadly speaking, the methods if only to know the appropriate
search terms.




Through heroic forensic work,
he traced the code to First 4 Internet, a British provider of
copy-restriction technology that has a deal with Sony to put digital
rights management on its CDs. It turns out Russinovich was infected
with the software when he played the Sony BMG CD
Get Right With the Man by the Van Zant brothers.

Here's WIRED Magazine's take on the story, “The Cover-Up Is the Crime

And here's what Dan Gillmor had to say about it, with additional links.




We should be talking to — and learning from — each other
Nov 3rd, 2005 by JTJ

Another example of how journalists can learn from other disciplines comes to the surface in the form of an LA Press Club meeting Nov. 9.



Digging deep: What reporters can learn from and about private investigators,” is the topic, and the panel of speakers, though large, seems rich with potential.

Here at the IAJ we also value the well done blog, “PI News Link,” run by Tamara Thompson.  Check it out; enter it in your blog harvester.



Web scraping with Excel [Saturday highlights from the Global Investigating Journalism conference]
Oct 1st, 2005 by JTJ



 
Tommy
Kaas, of the Danish
International Center for Analytical Reporting
, just
presented a fascinating session on how to use Excel tools to
“scrape”data off the web an import it into Excel, at least Excel XP. 
This is typically helpful where one needs to extract data from standardized tables
on dynamic web sites, for example those with demographic, economic or crime
data.

He has posted some handouts at dicar.org/global2005 or http://www.dicar.org/global2005/exercise_macroscraper2.htm

.
It's not yet clear to us if this is more efficient than writing PERL
or PHP scripts, but it's still an elegant hack.


 

Some great sessions at the Global Investigative Journalism Conference
Sep 30th, 2005 by JTJ

Friday's highlights from the conference in Amsterdam….



Henk van Ess has given two fine training sessions yesterday and this morning.  The first:



Training 02: Forensic surfing (Thursday 14.00 – 15.15)
How can you figure out the reliability of a website –
even without opening the site? How do you find the owner of a web site? How can you see how old a page is,
even if it doesn't say 'Page last updated at..'? How do you find the author of a Word document?
Welcome to the world of forensic surfing. Extra: CD-ROM with the course 'Internet Detective' for all participants.


Watch the HTML version at www.searchbistro.com/forensic.htm



The second session:

Hacking with Google (Friday 9.30 – 10.45)

“People make mistakes. They put sensitive data
on servers. They forget to remove delicate material. They leave
directories open with hidden files. Learn how to use Google in a
different way. The best search techniques for finding secret documents
from governments, institutions and companies. Open them with the right
questions. Henk van Ess
(AD, Netherlands) teaches you what sort of words you have to type,
which special syntax you have to use and how you should interpret the
answers. Note: this training will teach you how to find material that
shouldn't be on the web. It doesn't teach you how to hack into systems.”
This presentation can be viewed at www.searchbistro.com/hack.htm
There is a companion book – The Google Hacker’s Guide:

Understanding and Defending Against the Google Hacker by Johnny Long (johnny@ihackstuff.com)
— partial section at www.searchbistro.com/googlehacks.pdf



 



Course in crunching that health data
Sep 27th, 2005 by JTJ

Profs. David Kleinbaum and Nancy Barker will present their
online short course “Analysis of Epidemiologic Data” Oct.
14 – Nov. 11 at
statistics.com.  Topics covered in the
course include: simple analysis of 2×2 tables, control of
extraneous variables (including an introduction to logistic
regression), stratified analysis, and matching.

David Kleinbaum, a professor at Emory University's Rollins
School of Public Health, is internationally known for his
textbooks in statistical and epidemiologic methods and as
an outstanding teacher.  He is the author of “ActiveEpi”
and “Epidemiologic Research- Principles and Quantitative
Methods” and has also taught over 150 short courses over
the past 30 years throughout the world.

Nancy Barker is a consulting biostatistician and a co-
author of the “ActivEpi Companion Text,” and has over 10
years of experience teaching short courses in epidemiology
and biostatistics at Emory University and the Centers for
Disease Control and Prevention.

As with all online courses at statistics.com, there are no
set hours when you must be online, and you can interact
with the instructor over a period of 4 weeks via a private
discussion board.  We estimate you will need about 10 hours
per week.

Registration: $399 ($299 academic)
http://www.statistics.com/content/courses/epi3/index.html


Peter Brucepbruce@statistics.com

P.S.  Also coming up – “Clinical Trial Design” Oct. 21 –
Nov. 18 with Dr Vance Berger.
statistics.com
612 N. Jackson St.
Arlington, VA 22201
USA


Yes, you ARE being watched
Sep 22nd, 2005 by JTJ

Another
piece in The Guardian this week (some of the Brit papers are a very
good read) discusses how Tesco harvests — and then replants —
customer data.  This is of interest because Tesco, a British
company, is hankering after the U.S. grocery chain, Albertson´s. 




See “Tesco stocks up on inside knowledge of shoppers´ lives´´ below and “
Profile of an upmarket C10 desertersidebar.





Tesco stocks up on inside knowledge of shoppers' lives

· Crucible database is exhaustive – and secret
· Government bodies are tapped for information

Heather Tomlinson and Rob Evans
Tuesday September 20, 2005

Guardian

Tesco
is quietly building a profile of you, along with every individual in
the country – a map of personality, travel habits, shopping preferences
and even how charitable and eco-friendly you are. A subsidiary of the
supermarket chain has set up a database, called Crucible, that is
collating detailed information on every household in the UK, whether
they choose to shop at the retailer or not.

The
company refuses to reveal the information it holds, yet Tesco is
selling access to this database to other big consumer groups, such as
Sky, Orange and Gillette. “It contains details of every consumer in the
UK at their home address across a range of demographic, socio-economic
and lifestyle characteristics,” says the marketing blurb of dunnhumby,
the Tesco subsidiary in question. It has “added intelligent profiling
and targeting” to its data through a software system called Zodiac.
This profiling can rank your enthusiasm for promotions, your brand
loyalty, whether you are a “creature of habit” and when you prefer to
shop. As the blurb puts it: “The list is endless if you know what you
are looking for.”

This
publicity material was, until recently, available on the website of
dunnhumby, but now appears less forthcoming. Attempts by a number of
Guardian reporters to retrieve their own personal information under the
Data Protection Act led to a four month battle; the request was
ultimately denied so the Guardian has appealed to the Information
Commissioner. Tesco has provided some personal data held by Clubcard,
the loyalty scheme that monitors members' shopping and which has been
credited with fuelling the supermarket group's astronomical growth in
the past decade.

But
as far as Crucible is concerned, the company admits it has “put great
effort into designing our services” so information is classed in a way
that circumvents disclosure provisions in the Data Protection Act.
Clues about the content of dunnhumby's database have appeared in the
company's marketing literature. Crucible, it says, is a “massive pool”
of consumer data. “In the perfect world, we would know everything we
need to know about consumers. We would have a complete picture:
attitudes, behaviour, lifestyle. In reality, we never know as much as
we would like.” But Crucible, it suggests, has got much further than
rival systems by pooling data from several sources and then using the
vast Clubcard data pool to profile customers.

Together,
Crucible and Zodiac can generate a map of how an individual thinks,
works and, more importantly, shops. The map classifies consumers across
10 categories: wealth, promotions, travel, charities, green, time poor,
credit, living style, creature of habit and adventurous.

A
“Mrs Pumpkin” is cited: she makes pennies work when she shops, mostly
uses cash, has a steady repertoire of products but experiments with the
new, shops at various times, spends a little more on eco-friendly
items, is involved with charitable giving, is rarely away and likes
promotions for things she buys.

How
does Tesco get the information? Clubcard is used to target promotions
at particular cardholders. But Crucible is separate and Tesco insists
that while loyalty scheme data is used by Crucible it does so
anonymously rather than a house-by-house, name-by-name basis.

Dunnhumby's
chairman, Clive Humby, offers a few more clues. Companies such as
Experian, Claritas and Equifax have databases on individuals and
Crucible collects from them all. Any questionnaire you may have
completed, any reader offers you responded to, are bought to build up a
picture of attitudes and habits. Crucible also trawls the electoral
roll, collecting names, ages and housing information. It uses data from
the Land Registry, Office for National Statistics and other bodies to
generate a profile of the area you live in. Zodiac is employed to
provide a more detailed profile. The combination is valuable to many
consumer goods firms: dunnhumby generated profits of £4m on sales of
£28m in the last year for which accounts are available. Some £12m of
business was done directly with Tesco.

Mr
Humby and Edwina Dunn founded dunnhumby. The two have a reputation as
shrewd operators in the marketing industry and still own shares in the
firm alongside Tesco's majority stake. How the supermarket group and
other customers use the data is less clear. One former employee
involved in the company's marketing told the Guardian that it can be
used to decide how to target offers to individuals or where to open new
stores.

A
Tesco spokesman said last night: “All work carried out by dunnhumby is
regulated by the Data Protection Act and the Direct Marketing
Association Code of Practice.” But, as the supermarket unveils yet
another set of sparkling half-year figures today, one thing is clear:
while past success may have been built on the company knowing its
customers, Tesco plans to secure its future by knowing everyone else's
customers as well.

Profile of an upmarket C10 deserter

When
it comes to my personal information, I'm a natural paranoid. So when
signing up for a Tesco Clubcard to get those cashback vouchers and
offers, I made a point of providing as little information as the
application would allow.

No
matter. According to Tesco's disclosures under the Data Protection Act
(DPA), in the year my card was in use the supermarket managed to build
a substantial – if rather wayward – portrait of this reluctant
shopper's habits. A formal DPA request, followed by numerous letters to
and fro, a terse telephone conversation and finally, a fax explaining
that, yes, this information would be used in a journalistic exercise,
finally produced two sides of information.

Apparently,
I'm a gal who hankers after “finer foods”- indeed, a “natural chef”,
though friends tell me this probably has more to do with my tendency to
cook with natural ingredients than any signs of being a budding
Nigella. I am, Tesco determines, “upmarket” – a reference, I suspect,
to my habit of buying organic food (Green & Blacks mint chocolate
being a particular favourite).

The
database defines me through the past four years, placing me in the
mysterious “C10” category for 2003, having been an “H13” a year earlier
– whatever that means. My “family type” is “other,” though alternative
social options are not listed. Most importantly for the supermarket, I
just don't spend as much as I could there. Under “share of spend” with
Tesco I am deemed to have “potential”.

My
household carries a “reference number”, the date of my last visit, with
branches used in the past. It says whether I have used Clubcard
vouchers and correctly states I do not want my personal information to
be passed to other parts of the “Tesco Group”. There is no information
as to whether I am diabetic, teetotal or have a special diet.

Five
slots describe my “shopping habits”, each carries the words “Not
shopped in last eight weeks”. Clearly, I'm a Tesco deserter and a prime
candidate for those £10-off vouchers that have been dropping through
the letter box of late.

· To learn how to get your personal information under the Data Protection Act, see www.guardian.co.uk/foi

Guardian Unlimited © Guardian Newspapers Limited 2005





Doing more with less (printing plants, that is)
Sep 22nd, 2005 by JTJ

The UK paper The Guardian carries a couple interesting pieces this week
on the British company, The Press Association, or as it is know now,
the PA Group.  Essentially, it demonstrates that investment in
creative people who can leverage digital technology can make
money. 

See ´´The new heart of British journalism´´ and “Service used by every paper makes only 1% of the money
´´

The new heart of British journalism

A sleepy Yorkshire town has become the hub of an international publishing operation

Martin Wainwright
Tuesday September 20, 2005

Guardian

Twice
now, extraordinary things have happened to the sleepy market town of
Howden – little more than a village on the rich, flat land where the
river Humber is joined by the Yorkshire Ouse. The first time, in the
1920s when the local airfield became the centre of Britain's airship
industry, ended abruptly with the loss of the R101 (and the then air
minister) in a storm over northern France. The second time is now, and
it shows no sign of collapsing at all.

Quietly
over a decade, Howden has become one of the biggest centres of
journalism in the country. More than 650 staff of the Press Association
– well over double the organisation's workforce in London – occupy
buildings scattered round the quaint streets, as if an Oxbridge college
had dropped in. Editorial trainees are in the Bishop's Manor, a
medieval roost with jumbo plasma TV screens in the fireplaces where the
Bishops of Durham used to warm up after trekking down from the
north-east. Guests from London stay in a redbrick Georgian manor house
which looks like something out of Jane Austen.

The
high command of PA Sport has the vast, curving top floor of a
purpose-built office block which replaced the town's redundant police
station and magistrates' court two years ago. From here, among scores
of other sports information services, Premier League goals and match
analysis are texted live to mobile phones all over the world.

Howden
is the main laboratory for PA's expansion from a comprehensive and
reliable news-wire into the structural support for newspapers,
websites, television, radio and magazines. The guts of the service is
produced elsewhere, by reporters at news events, parliament or sports
fixtures, but the processing and ever more imaginative marketing go on
in Yorkshire.

Tony
Watson, PA's editorial director, a multiple award-winner and former
editor of the Yorkshire Post, relishes the innovation. Outside his
office on the ground floor, reporters' material is slimmed into
Teletext bulletins (“An excellent subediting exercise,” he says. “The
contents have to have exactly the right wordage to fill a line across
the screen.”) On the next floor up, the same data is repackaged for
listings and, with extra content, for breaking-news sections on
websites, including the Guardian's. On the top floor it gets
reprocessed again for sport.

Another
section turns it into mini-bulletins for mobiles, text-only or with
pictures. There are initiatives to expand it into digital TV, with a
studio just opened and a specialist journalists' training course
starting next month. Although PA has always been, and remains, modestly
anonymous, its Howden super-office is starting to publish on a scale
most editors must envy.

Touring
the main building, Watson points out a wall pinned with national and
international news pages from British local newspapers. Copy has always
been provided for these by PA but now staff at Howden offer story
choice and complete page layout too. A couple of those magazines dished
out by rail companies are produced here with advertising and printing
subcontracted to regional newspaper customers of PA. A canny use of
partnerships has been part of the agency's growth. The editorial centre
grew out of joint working with now vanished Westminster Press. PA
Weather, which now sells its meteorology to road-gritting departments
as well as the media, has just taken over the other, Dutch half of the
joint operation.

Howden
is now full up, says Watson, whose colleague Chris Buckley, managing
director of PA Sport, takes over half the middle floor on Saturdays,
when football needs 70 extra staff and the listings terminals are
briefly unoccupied. There has been criticism about PA pay rates – this
month the National Union of Journalists published a survey showing
levels as low as £12,000 a year at Howden. But the size of the
operation is buoying the flagging local economy, and vacancies are
quickly filled.

And
now there is India. By November, 50 staff will be backing up the
Yorkshire operation in offices in Mangalore, on the south-west coast of
India, which are also designed to be a jumping off point for further
news and sport packaging overseas. “There's tremendous interest in
British sport in Asia,” says Watson, describing automated systems in
Howden which text or email results, as they happen, in Cantonese, Thai,
Mandarin and many other languages. “But there's also a growing number
of fixtures locally, which we can handle either for other markets or
for the countries involved.”

Two
recent deals see PA distributing German sports results in Germany and –
from this autumn – selling South African premier league reports and
results within South Africa. Mr Buckley says: “They're holding the
World Cup there in five years' time and Fifa has recommended the
data-processing system as a model for the rest of Africa.”

After
the R101 tragedy in 1930, there was gloom in Howden when glamorous
airship designers stopped coming from London. Today, the “Howden
Flyer”, a direct, two-hour train service from London which stops at the
town six times a day to drop off largely PA clients, is only going to
get busier.

Guardian Unlimited © Guardian Newspapers Limited 2005


»  Substance:WordPress   »  Style:Ahren Ahimsa