Friday, November 14, 2008

The Social Life of Film Preservationists

Gracy’s piece (Gracy, Karen. Film Preservation: Competing definitions of value, use, and practice. Chicago: Society of American Archivists. 2006. Chp. 8) is really interesting from our perspective as students in the Ischool, because it really examines the work that a film archivist actually does, from inspecting the film, to negotiating with labs, to selecting what can be saved. It would be helpful to study many different types of positions in this field (libraries, archives, digitization), since professionally there are so many different kinds of positions and kinds of work to be done, and this type of anthropological writing, examining the work that people do, is so rare. We read a chapter of Gracy’s work in Caroline Frick’s Politics of Preservation course last year. It reminded me of readings that I did in Doty’s Users course about studying the way that people work and the way that people share information and gain knowledge on the job, primarily through gaining experience and watching other ‘experts’ in the field (The Social Life of Information, Brown and Duguid). This is why interviewing people, and working on case studies of archives and other institutions can be so helpful for students, because people on the job can succinctly sum up what the main issues are within the field.

For me, the most interesting aspects were the political discussions about deciding which films should be saved. This is something that a digital preservationist really decides, and there is never a right answer.

Friday, November 7, 2008

Viewing two digitized film collections

I looked at two archives online (note: It seemed that The University of Maryland site’s videos were not accessible to people outside of the University of Maryland).

The first site I looked at was the Internet Archive (archive.org), which has a lot of interesting films to watch. I had been on this site before. Anyone can upload videos here. Collections are subdivided into subject categories, or people can just use a keyword search. I first looked in the “Cultural and Academic Films” category, and found the University of Pennsylvania’s Museum of Archaeology and Anthropology collection, which includes a collection of digitized 16mm films made by Watson Kintner, during his travels around the world from 1933 to 1969. I watched “1967 #12 Tunisia.”

It is available in downloadable MPEG 1, MPEG 2, MPEG 4 and Streaming formats. Like most films on the Internet Archive site, the work is not formally cataloged, just tagged with a few words. It also includes a shot list though, and reel numbers. This must have all been compiled originally at the University of Pennsylvania and uploaded by them.

When “full screen” it looks bad, there is lots of blocky data. When it is not blown up, it doesn’t look so bad. It’s silent and in color. The color looks beautiful to me, though maybe it is a little faded.




“Theme from Shaft Hip-Hop Remix Video” 2008, was listed as a featured open- source video so I thought I would check it out. I'm not sure how they decide to 'feature' videos. The footage of this one was interesting to watch, but I have to say I didn't really get in to the remix.



This was just something that someone made, so it isn’t cataloged, though there are a good number of tags on the work. I’m wondering how some of this stuff is not under copyright, since it is in the open source section, and I don’t really believe that this video could just be used by anyone. Since it comes from a lot of different clips, some scenes look much better than others, which is interesting to look at in a digitization context. For the most part, it looks pretty badly pixelated though, probably the worst of anything I watched today.

It’s simply described as, “A Hip-Hop remix of Isaac Hayes' "Theme from Shaft" strictly for the B-Boys. The video includes classic footage from Wattstax, Shaft, Wild Style and other classics paying tribute to Mr. Hayes' contributions to Hip-Hop culture.” (Presumably this was written by the person who made this).

It’s available in Quicktime and MPEG4.

Finally I looked at the amazing “Disneyland Dream,” which is 1955 home movie footage of the Barstow family, who won a nationwide contest to take a trip to Disneyland. In 1995, Mr. Barstow narrated the story, turning the film into a little documentary, and he is quite funny:



It’s available in MPEG 1, 2 and 4, as well as streaming. Again, it looks pretty pixelated. I chose this item because the Internet Archive has a way of showing how many times things have been downloaded, and this was one of the most downloaded videos. They also allow users to rate the videos with stars, which is somewhat helpful. There’s no information about how long the video is, until you start playing it, this was true of all of them. This one also was not cataloged, just tagged. The Internet Archive gives information about the producer, but since everyone uploads their own content, I would assume that most do not include information about the digitization process, and these three were no exception. The Internet Archive does provide thumbnails from every minute of a video, which, while definitely not ‘cataloging,’ does give the user a little more information before he or she watches the film.

Overall, I had no problem viewing the streaming files. They didn't start and stop, and they just played in the browser, which is simple.

I also looked at the site “American Memory” motion picture collection from the Library of Congress, http://memory.loc.gov/ammem/browse/ListSome.php?format=Motion+Picture

I ended up viewing ‘Early Films of New York, 1898-1906. These files were much better cataloged then the Internet Archive collection, which makes sense because they are from the Library of Congress, and on the Internet Archive, anyone can add anything. They also have more information about how the videos can be viewed, which is helpful. Users can view the videos with RealMedia, Quicktime, and MPEG formats, all streaming. As a Mac user, I was able to easily use the Quicktime and MPEG formats, though they are quite small. (The MPEG is a little bigger). And the quality is not great on either version.

One thing that is really nice about this site, is that they give you contextual information about the collection. “New York City at the Turn of the Century,” “America at the Turn of the Century,” and “Pioneer Cameramen” are some of the educational pages that this collection includes. I would think that this could be a good resource for teachers. While this is not really a way to ‘describe’ the work, it does give the user more background information, which I would think a library would want to provide. Users are able to browse by subject, search by keyword or view an entire list of the films available. I browsed by subject. These records included information about the copyright holders, date created, cameraman, location of filming and descriptions. They also include the location of the holding of the physical film, as well as a digital ID number, which of course would be useful.

I watched a “Sleighing Scene” created by Thomas Edison’s company in 1898. http://memory.loc.gov/cgi-bin/query/S?ammem/papr:@FILREQ(@field(SUBJ+@od1(Sleighs--New+York++State+--New+York+))+@FIELD(COLLID+newyork))

As well as a film of the demolition of the Star Theatre in New York, over approximately 30 days in 1901:

http://memory.loc.gov/cgi-bin/query/S?ammem/papr:@FILREQ(@field(SUBJ+@od1(Star+Theatre++New+York,+N+Y+++))+@FIELD(COLLID+newyork))

And a parade in Washington Square Park, “Parade of "exempt" firemen / American Mutoscope and Biograph Company.”

http://memory.loc.gov/cgi-bin/query/S?ammem/papr:@FILREQ(@field(SUBJ+@od1(Washington+Square+Park++New+York,+N+Y+++))+@FIELD(COLLID+newyork))

Thursday, October 30, 2008

Film generation

Today my topic is: “Film generation (original negative, fine grain or projection print, answer print, work print, etc.)”

For a preservationist, it’s important to think about the life-cycle of a film object, starting with its beginning in the camera, through its adolescence as it is edited and processed, its middle-age as it reproduces into prints, to its somewhat final resting, as its decaying body is kept alive in an archive. Now, with digital technology, many of the traditional processes used in the creation of a film are done digitally, but film archives, of course collect old films, which could have been created in a number of ways. When dealing with issues related to ‘restoration,’ preservation, and arguments about different versions of a work, knowing what element of the film you have in your collection could be important.

Generally, it seems that film archivists want to preserve the version that is as close to the first generation as possible, though different versions may also be valuable and interesting for research purposes. If a film gets re-made and is further away from the original print, quality can be lost. We have probably all noticed that quality is lost when film is transferred to video, but the same thing can happen through generations of film, especially if they are not handled well or if it is a popular film and many copies are made.

As, I’m unfamiliar with a lot of this terminology, I’ll try to provide the definitions of some of the things I’ve been asked to write about:

OCN: The original camera negative (OCN) is defined on Wikipedia as “the film in a motion picture camera, which captures the original image. This is the film from which all other copies will be made. It is known as raw stock prior to exposure.” (http://en.wikipedia.org/wiki/Original_camera_negative).


Workprint: “After the film is processed by the film lab, they will assemble the camera rolls into lab rolls of 1200 to 1500 feet. Workprints may be made for viewing dailies or editing the picture on film.” (http://en.wikipedia.org/wiki/Original_camera_negative).

“A workprint is a rough version of a motion picture, used by the film editor(s) during the editing process. Such copies generally contain original recorded sound that will later be re-dubbed, stock footage as placeholders for missing shots or special effects, and animation tests for in-production animated shots or sequences.” (http://en.wikipedia.org/wiki/Workprint).

Answer print:

“Answer print refers to the first version of a given motion picture that is printed to film after color correction on an interpositive. It is also the first version of the movie printed to film with the sound properly synced to the picture… They are used by the filmmaker and studio to ensure that the work going in to the film during the post-production process is cohesive with the final goals for the project.” (http://en.wikipedia.org/wiki/Answer_print).


Interpositives and Internegatives

“After approval of the answer print, interpositives (IPs) and internegatives (INs) are created, from which the release prints are made.

…the IPs and INs are regarded as the earliest generation of the finished and graded film, and are almost always used for transfers to video or new film restorations.” (http://en.wikipedia.org/wiki/Original_camera_negative).


“An interpositive, IP or master positive is an orange-based motion picture film with a positive image made from the edited camera negative… The interpositive is made after the answer print has been approved. All lights and opticals from the answer print are repeated when striking the interpositive, and once the IP exists, the original negative can be vaulted.

…[it] historically has had only one purpose, namely, to be the element that is used to make the internegative…the only time the IP is touched is on the occasion of making the first or a replacement internegative. Since interpositives are used so rarely, they are usually the film element that is in the best condition of all the film elements." (http://en.wikipedia.org/wiki/Interpositive).

“An internegative is motion picture film stock used to make release prints for distribution to movie theatres” (http://en.wikipedia.org/wiki/Internegative).

Release print:

“A release print is the reel of film that is sent to a movie theater for exhibition.” (http://en.wikipedia.org/wiki/Release_print).

I’m assuming that the fine grain print and the projection print are somewhat similar to what is called here the “release print.” Anyone can correct me on that if they have more information about that. Thanks.

Thursday, October 23, 2008

What’s going on right now in news and television preservation?

I'm sure there is a lot going on in both of these areas, but I decided to focus on a project currently underway, funded by the Library of Congress, called Preserving Digital Public Television. ( http://ptvdigitalarchive.org/ ) While some programs are still shot on film or on analog video, many are digitally shot, and virtually all of them are digitally edited. This digital content needs to be preserved. The program site states that there is no mandate and little funding for the preservation of the rich cultural resource that is public television. The project is working on developing a repository and standards, creating a test model, creating guidelines for appraisal and looking at possible sources of funding for the project.

The Web site also discusses the difference between preserving the analog materials and the born-digital files:

“We are rapidly approaching the “tapeless environment” – where programs will live solely as “disembodied” assets, attached to their metadata, distributed and stored in a totally digital environment. This introduces an entirely new set of issues and problems relating to long-term program preservation, for which no coordinated strategy yet exists in public television.

While digital material is generally easier to duplicate, it is also more fragile. Hard disks fail at the rate of roughly 2 percent per year, which means that digital materials must be constantly checked, backed up, restored, and migrated from older to new disks.”

They have been making inventories of at risk programs and creating educational materials on file formats and metadata. They are also working with Turner Broadcasting to develop a standard MXF wrapper for preservation of program files.

In the future they hope to work preservation into the workflow of news and television programs. They are working with PBS and NYU on this project. The organization of the project is made more difficult because video and analog materials are not all stored together, and even though they are public programs, copyright is an issue.

CPB has been developing the PBCore metadata standard. (http://www.pbcore.org/ ). PBCore is similar to a Dublin Core (http://dublincore.org/) schema. Similar elements include Identifier, Title, Subject, Description, Creator, Language, etc. Some of the elements I did not recognize from DublinCore were AudienceLevel and AudienceRating.

To compare what the U.S. is doing to other countries the Web Site writes, that while the U.S. is having problems making things accessible online because of copyright, the BBC, the The Institut National de l’Audiovisuel (INA) in France, and programs in the Netherlands and Japan, are all working to put massive amounts of material online and accessible.

Finally, if you are interested, here is a Web cast of Nan Rubin about preserving digital public television at Thirteen. http://www.loc.gov/today/cyberlc/feature_wdesc.php?rec=3848

Friday, October 17, 2008

VRA Core

According to the VRA Core Web site, (http://www.vraweb.org/projects/vracore4/) VRA Core 4.0, (the most recent iteration of this metadata schema) was created by the Visual Resource Association’s (VRA is an organization dedicated to research and education related to managing images) Data Standards Commmittee , and is geared towards the ‘cultural heritage community.’ It can be used to describe works of visual culture, images that document those works, as well as collections of these objects. Version 4.0, released in 2007, is closely related to the content standard CCO (Cataloging Cultural Objects). VRA Core 4.0 can also be used within METS.

The VRA Core Web site includes a PDF “VRA Core 4.0 Introduction,” from which the following info is derived. VRA Core does not really have any required element types, however there are 5 core element types that generally should be described for all works. Those are:

WORK TYPE (what)
TITLE (what)
AGENT (who)
LOCATION (where)
DATE (when)

In VRA Core 4.0, “Agent” is a broader term used instead of “Creator,” and can be refined using sub-elements, such as “name,” “role,” and “culture.” “Culture” would include data about the culture or nationality of that agent. The other element, “Cultural Context” denotes the culture within the work or image was created, which is not always the same.

The VRA Data Standards Committee has also developed an XML Schema for VRA Core 4.0 elements. As such, data is divided into elements, sub-elements and attributes. (The VRA Core 3.0 used ‘qualifiers’ instead of sub-elements and attributes.)

In VRA Core 4.0, attributes can be used to modify an element or sub-element.
Some attributes are global because “they can be used to modify any element or sub-element rather than being tied to any specific one.” These include:
extent, dataDate, href, pref, refid, rules, vocab, source, and xml:lang.

The XML Schema allows collections to share information with others, and VRA Core 4.0 includes both a restricted and unrestricted schema, to offer collections some options for sharing.

VRA Core suggests on their site using controlled vocabularies to populate certain metadata fields. Suggestions include: Thesaurus for Graphic Materials (TGM), Art & Architecture Thesaurus (AAT), Union List of Artist Names (ULAN), and the Thesaurus of Geographic Names (TGN). They also suggest using a standard for formatting the data in the record, the Cataloging Cultural Objects (CCO) guidelines.

As with the Dublin Core standard, every record describes only one object. This is referred to as the ‘1:1 priciple.’However, the “relation” can show the ways in which different object and resources are related. These relations can be ‘work to work,’ ‘image to work,’ or ‘image to collection/work to collection.’

There are also administrative elements, like “source” and “rights.” “Source” operates differently for a work or an image record. For the Work Record, “source” includes data about the source of information where the cataloging information is taken from, whereas for the Image
Record source includes data about the publication or person from whom the image is taken.

Monday, October 6, 2008

File Systems: An Important Topic for Digital Storage and Preservation

Before I started looking into what file systems were, or why they might be important for digital preservation, I had an idea of what they might be: the way that files are organized on your computer. There is, of course, a little bit more to it than that, and those of us interested in the organization of digital information, should know about the basics.

Different computer operating systems have different file systems for organizing information, both for presentation to the user through the GUI, and also for organizing on the hard disk for ease of access by the computers. The different aspects of how the file system is designed will show up in the way that ‘files ‘ are arrange in ‘folders’ within ‘directories’ on your computer. Is there a flat or a hierarchical structure? How long can file names be?

According to Wikipedia (http://en.wikipedia.org/wiki/File_system):
“More formally, a file system is a special-purpose database for the storage, hierarchical organization, manipulation, navigation, access, and retrieval of data.”

Common file systems are NTFS, the standard for Windows NT, including Windows 2000, Windows XP, and Windows Vista. It replaced a file system called FAT, improving on FAT in a number of ways, according to Wikipedia (http://en.wikipedia.org/wiki/NTFS), including the support of metadata, improved and speedier performance for getting to files, and more security, including the use of "journaling," which means that the file system documents itself, so that in a crash less information will be lost.
Macs use a file system now called HFS+.

I actually (surprisingly) found a really interesting and funny article on the history of file systems from Ars Technica. “From BFS to ZFS: past, present and future of file systems” http://arstechnica.com/articles/paedia/past-present-future-file-systems.arsin by Jeremy Reimer from March 2008.

Thursday, October 2, 2008

The Format Wars: VHS

VHS (Video Home System) was developed by JVC in 1976, and beat out Sony’s Betamax, which had a higher quality of playback, presumably because VHS recorded a longer amount of time and cost less. VHS emerged in the 1980s as the standard for home viewing and recording and reigned until it was superseded by the DVD, which was introduced in 1997. Many studios stopped releasing VHS tapes by 2006, opting instead for DVDs. However, VHS tapes are still popular for recording television shows. VHS cassettes house ½ inch wide magnetic tape with a recording time of between two and six hours (Wikipedia: VHS, http://en.wikipedia.org/wiki/VHS).

Wikipedia goes into more of the technical information on VHS:

“VHS tapes have approximately 3 MHz of video bandwidth, which is achieved at a relatively low tape speed by the use of helical scan recording of a frequency modulated luminance (black and white) signal, with a down-converted "color under" chroma (color) signal recorded directly at the baseband. Because VHS is an analog system, VHS tapes represent video as a continuous stream of waves, in a manner similar to analog TV broadcasts.”


VHS tapes suffer from degradation of quality whenever they are copied. According to the EAI site on preservation of video (http://resourceguide.eai.org/preservation/singlechannel/basicquestions.html) there is no universal preservation format for videotapes. They state that DigiBeta is currently the archival standard.

Some similar formats to VHS cassettes are the VHS-C, which was used for home camcorders, and Super VHS (S-VHS), which was a more high quality version of VHS aimed at professionals. (Video Preservation Web site from Stanford: http://videopreservation.stanford.edu/vid_id/vhs.html).

This is a pretty cute video made about the current format war between VHS and DVDs:



The virtual museum of vintage VCRs includes some information about VHS formats, besides other video formats:

http://www.totalrewind.org/mainhall.htm

And the following includes some information about the very important 'Betamax' case, which deals with copyright law related to consumers rights to record video of material under copyright, for in home use:

http://www.museum.tv/archives/etv/B/htmlB/betamaxcase/betamaxcase.htm