Saturday, January 31, 2009

Nixon tapes again

Former Nixon White House counsel John W. Dean III delivering the keynote address at the annual meeting of the Society of American Archivists, 28 August 2008.

The New York Times has just posted an article concerning the ongoing controversy surrounding historian Stanley Kutler, who played a pivotal role in securing the release of White House tapes documenting the Watergate coverup and whose transcriptions of the tapes have served as raw material for other scholars. The latest chapter concerns an article submitted to the American Historical Review by historian Peter Klingman, who is among a small group of researchers and journalists --and at least one archivist formerly employed by the U.S. National Archives and Records Administration (NARA) -- who assert that Kutler's transcripts are problematic:
. . . Longtime critics of his transcripts say Mr. Kutler deliberately edited the tapes in ways that painted a more benign portrait of a central figure in the drama, the conspirator-turned-star-witness, John W. Dean III, the White House counsel who told Nixon that Watergate had become a “cancer” on his presidency.

Behind the accusations are rival visions of Mr. Dean, who is seen by some as a flawed but ultimately courageous man reluctantly sucked into the scandal, and by others as a primary architect of the cover-up who saved himself by deflecting guilt.
As the article notes, the controversy continues because the 1973 tapes at the center of it are not yet widely accessible to the public. In the mid-1990s, Kutler and a public-interest organization sued the federal government in order to obtain copies of approximately 200 hours of recordings that documented the White House's abuses of power and that had not been released to the public. NARA is gradually releasing the approximately 3,700 hours' worth of recordings in chronological order, but at present only those tapes created between February 1971 and December 1972 are publicly available; most of the November and December 1972 recordings are available online, and one of the tape processing archivists has written a summary overview of NARA's processing procedures.

The recordings at the center of this particular controversy were created in March 1973, and as the Times notes, they were released to the public in connection with a lawsuit that John Dean filed against one of Kutler's fiercest critics. Many Nixon scholars have since listened to these tapes, but they differ as to whether Kutler's transcripts accurately reflect their content.

Although the official release of the March 1973 tape recordings will probably resolve some of the major differences between Kutler and his critics, it is highly unlikely that it will put a definitive end to the controversy. As Kutler himself noted in the introduction to Abuse of Power, which includes his transcripts of these tapes:
The logistics of preparing these conversations for publication have been complicated and difficult. There are no transcriptions and the tapes cannot be removed from the National Archives at this time. Professional court reporters and transcribers prepared the initial transcripts. My research assistant and I then listened to the tapes to fill in significant gaps of "unintelligibles" and to insure accuracy as far as possible.The process of deciphering the tapes is endless. Different ears pick up a once-unintelligible comment, or correct a previous understanding. Such is the nature of the material.
Long after the complete run of Nixon tapes is released, scholars will likely continue to debate the meaning of all of the clicks, pops, hisses, and unintelligble words and phrases that the tapes contain. They will also continue to speculate about NARA's sound engineers' efforts to maximize the audibility of the tapes and the snippets that NARA's processing archivists are legally compelled to redact for national security, personal privacy, or other reasons. And, of course, they will differ as to how to interpret the information contained within these recordings and other archival records.

Controversies such as that focusing on the Nixon tapes and the Kutler transcripts are going to be with us for a very long time, and archivists aren't going to be the ones to settle them; we are stewards of the historical record, not the chief intepreters of it. However, if I worked for the Nixon Library or the NARA unit that is processing the Nixon tapes, I would be most interested in whether the American Historical Review opts to publish Klingman's article and in the content of the article itself. Heck, I don't even work for NARA, and my curiosity is piqued!

If your curiosity is also piqued, portions of Kutler's transcripts are available online via Google's Book Search and it looks as if the Times is planning to place audio excerpts from the March 1973 recordings on its Web site. The Times article concerning the controversy is slated to appear on page A1 of tomorrow's print edition, so Times staff may be waiting until tomorrow to enable the link to the audio files. I'll supply the link when and if it goes live.

Update, 1 February 2009: The Times has now placed links to the audio files in a sidebar that accompanies the main story; there is no separate link.

Thursday, January 29, 2009

PowerPoint to the People?

I don't expect that journalists will grasp the finer points of records management, and I recognize the acute time pressures that they face. I am nonetheless disappointed when a reporter or columnist whose work I generally admire makes a mess of things. Fred Kaplan, Slate's military affairs correspondent, has just joined the ranks of journalists who haven't done their homework.

In this week's column, "PowerPoint to the People," Kaplan starts by identifying another step that, in his view, would enable that the Obama administration could demonstrate its stated commitment to open government:
Force the federal agencies to file and maintain all the records they're creating now, so that in the future when citizens file [Freedom of Information Act] requests to declassify documents, they won't receive a form letter that reads, "Sorry, no such documents exist."
Archivists and records managers will immediately pinpoint the folly of this approach, which will result in the preservation of all kinds of materials that simply don't warrant long-term preservation, among them countless e-mail messages about routine matters (e.g., lost reading glasses, traffic problems, staff holiday parties), innumerable iterations of draft documents produced in the course of completing projects, duplicate copies of files disseminated for staff review or convenience, copies of billing records documenting routine purchases (e.g, pens, notepads), and other records of transitory value. In such a recordkeeping environment, the important stuff will probably be kept, but sifting through all of the digital detritus in order to find it might be a real challenge.

Most of "PowerPoint to the People" concerns a U.S. National Archives and Records Administration (NARA) assessment of recordkeeping practices within U.S. Air Force central offices. This report was completed in 2005 but remained an internal document until this week, when it was released as a result of a lawsuit filed by the National Security Archive.

Unfortunately, a close reading of the report itself suggests that Kaplan did not fully engage with it or do any sort of follow-up work. For example, as Kaplan rightly notes, the report indicates that "electronic records" generated by the fifteen units that comprise Headquarters Air Force "are generally not disposed of in accordance with" federal regulations. However, as the report plainly states, one of NARA's key findings was that "to date, this has largely resulted in retaining temprorary records indefinitely, as opposed to their premature disposal or the destruction of permanent documents" -- a conclusion that directly contradicts the keep-everything approach that Kaplan advocates.

Kaplan's dissection of the report's assessment of NARA's own capacity to manage electronic records also leaves the impression that this column was assembled with undue haste. He makes much of the report's assertion that NARA "is still unable to accept Microsoft Word documents and PowerPoint slides": PowerPoint is the preferred format for internal Pentagon briefings, and NARA's inability to accept PowerPoint files raises the possibility that a significant amount of archival records created by the military "may be lost to the ether."

NARA's apparent inability to accept PowerPoint slides or Word documents is truly distressing, and NARA's current transfer guidelines indeed indicate that, at least at this point in time, agencies cannot transfer files in these formats. Nonetheless, had Kaplan done a few quick Web searches he would have been able to advance a stronger and more nuanced argument.

For example, Kaplan, whose only source is the 2005 Air Force recordkeeping report itself, points out that:
The National Archives only "recently" —- it doesn't say how recently -— revised its procedures so that it could accept e-mail with attachments, scanned text documents, PDFs, digital photos, and Web content.
According to NARA's current electronic records transfer guidelines, NARA began accepting e-mail with attachments in September 2002 and continued expanding its list of acceptable file formats until September 2004, when it started accepting Web records. Why Kaplan didn't do a quick Web search -- or simply call NARA's press office -- is a bit of a mystery.

Kaplan also notes that:
The National Archives is developing an "Electronic Records Archive," so that it can finally deal with Microsoft Word and PowerPoint. But, according to the study, that is being "planned for implementation in the next seven years." (Italics added.) The study was written four years ago; so, assuming the program is still on track, it will be up and running three years from now, when Obama's first term is almost over.
NARA hasn't always been as forthcoming about the specifics of the multi-year, multi-phase Electronic Records Archives project, which began taking in records last summer, as some within the archival and records management communities would like. However, the NARA Web site contains a lot of information about the program, and tracking it down isn't particularly difficult.

Finally, Kaplan summarizes the report's recommendations regarding improvement of electronic records management practices as follows:
Meanwhile, the study urges all agencies to keep their electronic records in a safe place. Good luck with that.
In fairness, assessing the report's recommendations is a bit of a challenge: all of the higher-level recommendations have been redacted from the publicly released version of this report. However, the report contains many recommendations that were not redacted and are readily identifiable, among them:
  • Give the records management office greater visibility and authority by increasing the salary grade of the records management officer and placing all records management staff positions under the authority of the records management officer.
  • Develop detailed file plans for all Headquarters Air Force offices.
  • Maintain all records "in electronic folders on a shared drive in accordance with the [records] disposition schedule."
  • Headquarters Air Force should consider implementing an electronic recordkeeping system that complies with Department of Defense standard DOD 5015.2-STD.
  • Transfer to NARA archival paper records and electronic records encoded in formats that NARA can currentl accept.
  • Work with NARA to ensure that all electronic records are properly scheduled, i.e., classed as meriting permanent preservation or eligible for destruction at an agreed-upon time.
  • Taking steps to ensure that duplicate copies of electronic records are identified and properly disposed of.
  • Ensuring that records slated for transfer to a NARA-operated federal records center are indeed transferred appropriately.
One can argue that these recommendations fall short of the mark, but surely they amount to more than simply advising Headquarters Air Force to "keep their electronic records in a safe place."

I still like most of Kaplan's work; among other things, he's offered what is, in my view, the most cogent explanation to date of President Obama's decision to appoint Leon Panetta to head the Central Intelligence Agency. I also recognize that every now and then, a good columnist will produce a real clinker of a piece -- s/he may be chasing a big story, unable to marshal all the facts prior to deadline, or simply under the weather during a given week. I just wish that Kaplan's clinker had centered on something other than electronic recordkeeping.

Monday, January 26, 2009

Preserving Web sites

I really wish that I had been able to find more time last week to blog about all of the stuff that happened last week . . . .

First, we had some momentous changes at the federal level. As any archivist who hasn't had his or her head in the sand knows, the very first executive order that President Obama signed overturns President Bush's dread E.O. 13233 and should facilitate the timely release of presidential records. President Obama signed a memorandum reminding the heads of all federal agencies that "the Freedom of Information Act should be administered with a clear presumption: In the face of doubt, openness prevails." The archival blogosphere and listservs have been chock-full of commentary about these developments, and I really don't have much to add to the discussion at this point; suffice it to say that I'm really, really glad that E.O. 13233 is gone.

Yesterday, an opinion piece penned by Lynne Brindley, the head of the British Library, appeared in the Guardian. Noting that "personal digital disorder" -- our unwillingness or inability to save the digital photos and other electronic materials we create in a way that ensures their long-term survival -- threatens "to leave our grandchildren bereft," she asserts:
As chief executive of the British Library, it's my job to ensure that this does not extend to our national memory. At the exact moment Barack Obama was inaugurated, all traces of President Bush vanished from the White House website, replaced by images of and speeches by his successor. Attached to the website had been a booklet entitled 100 Things Americans May Not Know About the Bush Administration - they may never know them now. When the website changed, the link was broken and the booklet became unavailable.

The 2000 Sydney Olympics was the first truly online games with more 150 websites, but these sites disappeared overnight at the end of the games and the only record is held by the National Library of Australia.

These are just two examples of a huge challenge that faces digital Britain. There are approximately 8 million .uk domain websites and that number grows at a rate of 15-20% annually. The scale is enormous and the value of these websites for future research and innovation is vast, but online content is notoriously ephemeral.

If websites continue to disappear in the same way as those on President Bush and the Sydney Olympics - perhaps exacerbated by the current economic climate that is killing companies - the memory of the nation disappears too. Historians and citizens of the future will find a black hole in the knowledge base of the 21st century.

Brindley goes on to point out that, popular assumptions to the contrary, Google and other commercial entities are simply not capturing and preserving the "nortoriously ephemeral" but immensely valuable information found on the Web:
. . . . The task of capturing our online intellectual heritage and preserving it for the long term falls, quite rightly, to the same libraries and archives that have over centuries systematically collected books, periodicals, newspapers and recordings and which remain available in perpetuity, thanks to these institutions.
She then details the British Library's efforts to digitize some of its paper treasures, ensure the preservation of Web sites relating to the 2010 Olympic Games in London, and, "with appropriate regulation . . . create a comprehensive archive of materials from the UK Web domain."

Brindley is absolutely right, but there really is something missing from this article: an explanation of why libraries and archives must carry out this particular mission. I'm not faulting Brindley for this omission. The editors of the Guardian no doubt had a substantial amount of say in determining the length and overall content of this piece, and Brindley is using her ration of words to link the British Library's activities to a highly anticipated government report on the future of "digital Britain."

However, without explicit discussion of the role that libraries and archives play in preserving cultural heritage materials over very long periods of time and ensuring that the materials in their possession are authentic and unaltered, many people simply won't grasp why it's important that institutions such as the British Library are seeking to preserve electronic materials. A cursory glance at the comment section associated with this article illustrates precisely why this focus on the long term and on authenticity is needed: one of the commenters states that a copy of "100 Things Americans May Not Know About the Bush Administration" is currently available on another publicly accessible Web site and that the British Library simply doesn't know how to use Google. However, the commenter doesn't seem to have thought about whether the copy found on this Web site has not been altered or whether the site itself will be around in 10 years, let alone 100 or 1000 years; given that s/he also links to a parody of this booklet, s/he may simply have tongue planted firmly in cheek, but there is no way to tell from the comment alone.

Unless librarians and archivists do more to jolt people out of their present-minded view of the Web and digital materials generally and to underscore the importance of safeguarding the integrity of digital information that warrants long-term preservation, we're going to find it harder and harder to secure the resources we need to preserve and provide access to it. There simply is no alternative to emphasizing -- loudly and insistently -- that we seek both to serve today's researchers and to lay the foundation needed to ensure that future generations of archivists and librarians will be able to serve future generations of researchers.

Thursday, January 22, 2009

Cultural Education Center in winter

It's been a momentous week, and all kinds of interesting records-related developments have taken place, chief among them President Obama's issuance of a new presidential records executive order. However, I'm going to wait until the weekend to post about them. I'm doing a ton of research and writing at work this week, and the thought of pulling together a long post is a bit much right now.

In the meantime, here's a picture, taken on a bitterly cold evening in late November of last year, of the Cultural Education Center, which houses the New York State Archives (our stacks and some offices are located on the building's windowless uppermost floor), the New York State Library, and the New York State Museum.

This photograph really doesn't have any sort of deeper meaning -- even though New York State's budget situation looks pretty dark and icy -- and I post it simply because I've developed a deep fondness for the Cultural Education Center and the Empire State Plaza of which it is part. I realize that not everyone shares my views (I despised the plaza when I first moved to Albany), and I'm fully aware that the plaza is laden with deadening modernist cliches. Nonetheless, it is kind of cool to walk around a complex that looks like the set of a sci-fi movie, particularly at night. At any rate, I hope you enjoy this nighttime view of my workplace.

Tuesday, January 20, 2009

Allen Weinstein piece in USA Today

In lieu of commenting on the brand-new administration's brand-new blog, yesterday's federal court ruling concerning the records of the just-departed Vice President and what it says about the Presidential Records Act, or any of the other things that happened today, I'm simply going to point out that former U.S. Archivist Allen Weinstein wrote an excellent article for USA Today detailing significant inauguration ceremonies and speeches. It quickly, vividly, and accessibly distills a lot of scholarly research and reflection, and it's a sheer pleasure to read. Enjoy!

Saturday, January 17, 2009

Home Depot's "Dream" for MLK Papers

A few minutes ago, I was reading the Washington Post online and was stunned to encounter a Home Depot banner ad relevant to the world of archives: "Purchase this gift card, and we'll make a donation toward building a permanent home for the Martin Luther King Jr. Papers."

Clicking the ad took me to a Home Depot page outlining the promotion: purchase a special collector's edition "Dream" gift card between 9 January and 28 February 2009, and the Home Depot Foundation will donate 5 percent of the value placed on the card to the Center for Civil and Human Rights, which will become the "permanent exhibition home for the personal writings and papers of Dr. King."

From an archivist's point of view, the satisfying thing about this page is that it includes a brief description of the King Papers:
. . . . The extensive collection of original documents by Dr. King includes more than 10,000 items, among them 7,000 handwritten notes.

The papers span from 1946 to 1968, an especially active period in King's life, and include drafts of his "I Have a Dream" speech, his "Letter from a Birmingham Jail," other theological writings and his Nobel Peace Prize addresses . . . .
The page also includes links to the Martin Luther King, Jr. Research and Education Institute at Stanford University, the King Collection at Morehouse College, which holds the King Papers, and the Center for Civil and Human Rights, which, when finished, will document global civil rights and human rights struggles, with particular emphasis upon events that took place in Atlanta and Georgia.

Finally, the page points out the role that the Home Depot played in bringing the King Papers, which came harrowingly close to being broken up and auctioned off, to Morehouse College; given that the company has donated $1,150,000 to date and will give up to $1,000,000 more as a result of this gift card promotion, I suppose it's entitled to a bit of trumpet-blowing.

I know that corporate sponsorship of archives might, in some instances, have too many strings attached, but I'm really happy that Home Depot has made such an extensive commitment to preserving and raising the public profile of the King Papers. Explaining the value of the King Papers helps, in an indirect but very real way, to explain the importance of archives and manuscripts in general, and I hope that other corporations start seeing the preservation and provision of access to archival and manuscript collections as worthy of their support.

I don't spend a lot of time in Home Depot -- largely because I don't own a home -- but I'm starting to think about picking up a few "Dream" cards and using them as 2009 birthday, etc., gifts. Several people on my gift list will happily take advantage of any opportunity to ogle power tools, and all of them will be pleased to learn that the cards come with the added bonus of helping to preserve one of the nation's most significant collections of 20th century historical records.

Of course, not everyone has friends and family who rhapsodize over drills, saws, and routers, and some people simply prefer to shop elsewhere. Folks who want to see the King Papers preserved and made accessible but who don't need any gift cards can donate directly to the Community Foundation for Greater Atlanta, which oversees the King Papers Project, or to the Center for Civil and Human Rights Partnership.

Thursday, January 15, 2009

Coming up: an e-discovery tsunami?

Earlier today, Computerworld posted an interesting piece speculating that requests for information about the lending practices of failed banks may highlight sloppy records retention policies and practices and propel regulators to crack down on institutions that don't comply fully with Sarbanes-Oxley and other records-related laws and regulations. Among those quoted in the article is Debra Logan of Gartner, who predicts that disgruntled employers and customers will file all manner of lawsuits and that e-discovery and e-recordkeeping issues will come to the fore as a result:
The amount of litigation that's going to be generated out of this Wall Street meltdown is going to be unbelievable. The regulators will be asking the banks what happened . . . . Lawsuits stemming from problems at government-backed mortgage finance companies ' Freddie Mac and Fannie Mae will result in systemic change.
Other experts quoted predict that, in addition to stricter enforcement of existing laws and regulations, lawmakers and regulators might impose even more stringent record-keeping controls upon the financial sector -- and the health care industry, which is moving toward electronic-record keeping despite shortcomings in its records retention practices.

It will be most interesting to see how record-keeping practices evolve as people try to make sense of the chaos that has consumed the financial industry and come to grips with the challenges of electronic medical records. Maybe we will start seeing some real attention paid to records management -- and a diffusion of lessons learned in the financial and health care sectors to other industries and government.