Network Analysis with Gephi

Adding to the various software that we have worked with throughout this unit is Gephi, which allows the user to create network analysis graphs. Again, after viewing the example projects of Viral Texts, the Tudor Papers, and Linked Jazz, I thought I would be in way over my head. I especially felt this after viewing the Tudor Papers and the sheer number of paths that were charted with the letters and people that sent them. After I viewed the Linked Jazz project, I felt a bit better. So, when I began working on the data from the African American Films from 1909 to 1930, I better understood what I was getting myself into. Uploading the data was very simple after installing Gephi.  The first method of evaluating the data from the films was viewing the connections between the movies and actors. The below bimodal graph highlights this.

Not only can you customize the data’s color, background, and theme, but each point links you to the films the actor was in. Beyond this, you can also see the average distribution of the number of movies the actors participated in. This provides a better understanding of what the average number of films that the actors were in.

After working with the first data analysis, the second one showed the communities and connections between actors and specific films. Not only does it create groups based on shared projects, but you can also single out particular groups and evaluate the group members even closer. This fosters greater connections throughout the data. The below graph illustrates this.

Finally, when working with the data, you can expand the communities into an unimodal graph that charts all of the connections between the groups. After looking at the graph below, one begins to understand the vast network of the African American film industry in the 1900s.

Working with network analysis creates connections with the dataset and shows the broader picture of what that data is trying to tell the scholar. Gephi, in particular, was not only a relatively easy software to work with, but its vast customization and varying types of models create a wide array of options to represent one’s data.  It allows for scholars to answer basic questions such as: how are the various datasets connected? What are the patterns throughout the data? Are their specific data points more connected to others in the dataset? What is the overall significance of this data? This unit’s modules showed me the importance of data creation and representation and how much can be done with software relatively easily. Gephi unlocks the potential for researchers to create much more from their work.

Mapping with Kepler.gl

Working with digital mapping, this module truly showed me how much can be done with even a small amount of data. When viewing projects such as Photogrammer, the National Mall, and Mapping the Gay Guides, I was a bit overwhelmed by the vast extent of each project. An immense amount of time and effort seemed to go into these projects, not to mention the sheer amount of data. While this is not a bad thing, it just seemed to be a significant undertaking before I explicitly began working with Kepler. gl. It was not until I started working and using the Works Progress Administration’s Slave Narrative project that I better understood and was able to map out the locations of the various formerly enslaved individuals interviewed in Alabama. Before working specifically with Kepler.gl, I was familiar with digital mapping platforms such as Datawrapper, but I had never specifically worked with any software. Therefore, when I started working with Kepler.gl, I was pleasantly surprised when I found the software to be highly user-friendly and knowledgeable. After simply uploading data, the user can use various tools, such as different layers, to demonstrate and evaluate their data. One layer is merely pointed on the map to locate your input data. This can help you understand the overall coverage of your data.   Specifically for the slave narratives, it shows the vast space in which those were located. The graph below illustrates that.

You can also change the color of your points and the theme of the map that it is located on to assist with viewability. Another interesting layer that can be applied is a cluster layer that creates larger bubbles based on the proximity of the point’s location. Those that are large bubbles help illustrate the areas where the most people were interviewed and also show the relative location of the larger areas of enslavement. The heat map layer also shows the proximity but does so based on the color gradient of numbers. The graph below illustrates that.

Another factor that can be examined with the tools in Kepler.gl is charting the various types of slaves that those who were interviewed were. The graph below shows the varying nature of enslaved people in the house, field, or both.

Working with Kepler. gl is a valuable tool that not only can map out the locations of various data points, show the frequency for which they appear, and show varying specific information, but it can also show a timeline of when the data occurred. Data mapping not only creates another dimension to digital humanities data, but it is able to answer the questions of: where are the highest frequencies located? What changes occurred over time? Was one location’s conditions unique to that area? What are the patterns throughout the areas mapped? Digital mapping allows endless possibilities for data and for the scholar working with it, and I very much enjoyed working with Kepler.gl.

 

Text Analysis with Voyant

This module focused on the various forms of text analysis. When I began working on this unit, I was powerfully overwhelmed by the potential that data mining had. As someone who works in the humanities, but in history, the idea of data and vast amounts of it honestly scared me. It was not until I evaluated the various projects, such as America’s Public Bible and my favorite Robots Reading Vogue, that I better understood the importance of data mining. When I specifically worked with the data from the Works Progress Administration’s Slave Narrative Projects data, did I fully understand the critical importance and the essential questions data mining seeks to answer?

Working with Voyant, I learned the key ideas of text mining and the potential a corpus could bring, especially when working on a project with a great amount of data. After uploading the data that I was provided, Voyant created this extremely helpful textual analysis of various aspects of the narratives. Not only could one find the recurring words that appeared throughout many of the narratives, but it also allows you to see where certain words appear in the document and the context surrounding them. With Voyant, there is so much potential to evaluate trends, connections, and context throughout large data portions.

Voyant also allows the user to narrow their data into smaller subsections, such as individual states. The cirrus below is a visualization of the most common words featured in the slave narratives recorded in Missouri. Since I am from Missouri, it was fascinating to evaluate the stories of the formerly enslaved and this data in the larger picture.

This cirrus represents the most common words in Ohio, which differed from those in Missouri. Voyant allows users to compare and contrast critical factors, such as common words, throughout their different data options. This also highlights the differing experiences of the enslaved just a few states away.

Beyond the aforementioned, Voyant allows the user and creator of the data to see vast differences in frequency. In the graph below, I evaluated how the states of Missouri and Ohio differed in their use of the word “Old” in the narratives. Missouri had a much greater relative frequency for the word “old” than Ohio. This, too, highlights the importance of data mining and drawing conclusions based on the data.

Finally, this tool on Voyant summary shows the researcher various comparative issues within the data, whether it be the length of the document, the varying vocabulary, or even distinctive words. The distinctive words section is mainly what I focused on as I drew comparisons between Missouri and Ohio, as well as the larger picture of other states.

When I first began working with text mining and its surrounding process, I was terrified of what it entailed. However, after working with Voyant and seeing how significant data visualization and analysis is, I fully understand not only how important this work is, but with tools like Voyant, the process can be far simpler.

Humanities Data

The ultimate question that required an answer throughout this module was: why create data from humanities sources? Ultimately, the question of data lies in what the scholar seeks to discover. By creating data from your projects, one can find many aspects not previously understood from their work. One can discover patterns, relationships, and structures that are not apparent in reading the work. As Thomas Padilla shows in our readings, creating data creates greater possibilities for understanding and studying research. Using various tools such as data visualization, mapping, or spatial analysis allows large collections to be observed and comprehended far more easily than simple analysis. Specifically, I learned how complex and comprehensive data collection can be with our work on various projects such as the Tudor Networks, the Fairfax County Probate Records, and the Early African American Film. These projects highlighted this, but directly working with the Works Progress Administration Slave Narratives project and creating data specifically really made me realize how important creating data from documents, letters, and various other sources is to create a broader analysis field. In the case of the Slave Narratives, this data adds more humanity and greater emphasis on that individual story and how it connects to a broader context. Even though I only worked with three individuals, I felt a better connection to their story when I created their data. I also understood that with the right tools and sources, data creation is not as difficult as I once thought.

The questions that the data lets you answer that other methods do not are as follows: What patterns are seen throughout the given information?  What are the shifts and trends that occur throughout? What are common themes throughout the data? By creating data and answering these questions, the understanding of the subject is far greater than that of other projects.

When a scholar creates data from various sources, transparency is always key. The first aspect is transparency about how the scholar interpreted the data, whether it excluded certain items, created a common theme with names, and how the data was digitized. Normalization and the direct mention of this process are critical for the transparency of data creation. By explicitly stating how the data was developed and what factors created the data, the scholar creating the data has less ground for potential biases. Beyond the risk of biases, scholars can craft false arguments that would cause some to create the wrong conclusion. Specifically, stating what was undertaken to create the data and what was excluded is essential to the integrity of the field and the legitimacy of the scholar.

 

Why Metadata Matters

Before completing the metadata module, I had no real clue what metadata even was. I had heard the term used but had never truly engaged with it. Now, I fully understand its complexities and importance. A definition is essential to begin discussing metadata. Metadata is facts or attributes describing an item, such as a book, document, computer file, image, or artwork. These attributes are used to convey the digitized item and assist in the cataloging and processing digitized artifacts. Beyond this, it gives the item context in the greater field of research. Because of the nature of the current world, it is hard to access all material in person, and thus, the digitized image and its metadata assist immensely. In this unit, I digitized various items in my kitchen through photographs. The image below is of four skillet pans sitting on a stove. The metadata for this object is broken down into categories based on the Dublin Core metadata vocabulary. The critical pieces included are the title, the subject, a description of the photo, the source, the format, and the rights associated with the item.

This other photo was of many of the various coffee syrups and my toaster.

Using these images, I created metadata concerning the various dimensions of the photo and attributes of valuable resources such as Tropy, where I can store all of the images and the metadata surrounding them. After exporting the metadata to Omeka, I created a cohesive and well-organized exhibit of my digitized sources and utilized the metadata. This has been an amazing learning experience for me as I have discovered all of the valuable resources available for no cost and can improve the efficiency of one’s research. Metadata gives one easy access to the rights, format, type, original location, and where the item is stored.

Metadata is essential in the digital humanities because it provides an easy means of finding crucial aspects of media included in research. The key areas of particular importance to the digital humanities are prominence information or the original location and history of the item. Without this, the item merely becomes another ordinary object. As a historian, provenance is especially important in understanding the historical context.  Another key area of essential metadata is the rights of the object. When researching, one always has to be cautious not to violate copyright and fair use, and thus, having the rights information included with the data makes it far more simplistic. Finally, understanding the creator and where the item is currently housed is essential to digital humanities scholarship. Knowing where the object was digitized and is stored helps the researcher better understand the object within the archival context. Still, it also assists in understanding if any inherent biases are present. This is crucial because these biases could potentially harm one’s research.

Digital humanities scholarship also greatly benefits from the programs Tropy and Omeka. Tropy allows for importing all objects needed to catalog and create metadata in one central location, and the interface is highly accessible for the less technologically inclined. Storing these objects and creating metadata makes one step of the research process much more manageable. Using Tropy to create metadata also allows for the export of this data into Omeka. Omeka utilizes Dublin Core metadata vocabulary that is more detailed and provides more context to the items. Beyond this, Omeka allows digital humanities scholars to create exhibits to share their resources through a digital professional environment. Omeka is also important in the metadata organization and creates another central location for the research process. Overall, using, creating, and sharing metadata through platforms like Tropy and Omeka is pivotal to the digital humanities and the future of research.