Notebook

Packages required¶

In [1]:

import os
import pandas as pd
import numpy as np
from IPython.display import Image
import jaydebeapi
import urllib.parse
import sys
import matplotlib.pyplot as plt
import seaborn as sns

Overview¶

Marvel and DC comics have been around for several decades. Both Marvel and DC are known for their iconic characters, super-heroes and supervillains. While Marvel produced Spider-Man, Iron Man and Hulk; DC produced Superman, Batman and the Wonder Woman. Both of these publishers have diversified their content and expanded beyond traditional comic books to encompass various forms of media and storytelling.

DC and Marvel have created characters that transcend nationality and resonate with people worldwide. The iconic characters created by these brands have become a part of popular culture, prompting passionate debates among fans when comparing Marvel and DC heroes.

We delve deeper into the Marvel and DC universe with the help of a public dataset from Data.World called the 'Comic Characters Dataset'.

There are two data files within the dataset. Download each of them using the 'download' icon as shown below. Download the DC Dataset as shown below.

In [2]:

##Specify the path to your image file
image_path = 'dc-wikia-data_download_icon.png'

width = 500

## Display the image
Image(filename=image_path, width=width)

---------------------------------------------------------------------------
FileNotFoundError                         Traceback (most recent call last)
<ipython-input-2-3581f17e51f6> in <module>
      5 
      6 ## Display the image
----> 7 Image(filename=image_path, width=width)

~/.local/lib/python3.6/site-packages/IPython/core/display.py in __init__(self, data, url, filename, format, embed, width, height, retina, unconfined, metadata)
   1223         self.unconfined = unconfined
   1224         super(Image, self).__init__(data=data, url=url, filename=filename, 
-> 1225                 metadata=metadata)
   1226 
   1227         if self.width is None and self.metadata.get('width', {}):

~/.local/lib/python3.6/site-packages/IPython/core/display.py in __init__(self, data, url, filename, metadata)
    628             self.metadata = {}
    629 
--> 630         self.reload()
    631         self._check_data()
    632 

~/.local/lib/python3.6/site-packages/IPython/core/display.py in reload(self)
   1254         """Reload the raw data from file or URL."""
   1255         if self.embed:
-> 1256             super(Image,self).reload()
   1257             if self.retina:
   1258                 self._retina_shape()

~/.local/lib/python3.6/site-packages/IPython/core/display.py in reload(self)
    653         """Reload the raw data from file or URL."""
    654         if self.filename is not None:
--> 655             with open(self.filename, self._read_flags) as f:
    656                 self.data = f.read()
    657         elif self.url is not None:

FileNotFoundError: [Errno 2] No such file or directory: 'dc-wikia-data_download_icon.png'

Similarly download the Marvel Dataset.

In [ ]:

##Specify the path to your image file
image_path = 'marvel-wikia-data_download_icon.png'

width = 500

## Display the image
Image(filename=image_path, width=width)

Out[ ]:

Each data file (.csv) can be downloaded using the 'Download' button as shown below -

Do the same for the Marvel Dataset as well.

Loading the data into a dataframe and Data Cleaning¶

Loading the DC Dataframe¶

In [3]:

##Loading the data into a dataframe in Python
dc_df = pd.read_csv('dc-wikia-data.csv',sep=',') #Load the dataframe 
dc_df['YEAR']= dc_df['YEAR'].fillna(0).astype(int) 
dc_df['APPEARANCES']= dc_df['APPEARANCES'].fillna(0).astype(int)
dc_df = dc_df.rename(columns={'ID': 'identity'})
dc_df.fillna('', inplace=True)

Loading the Marvel Dataframe¶

In [4]:

##Loading the data into a dataframe in Python
marvel_df = pd.read_csv('marvel-wikia-data.csv',sep=',') #Load the dataframe
marvel_df['Year']= marvel_df['Year'].fillna(0).astype(int) 
marvel_df['APPEARANCES']= marvel_df['APPEARANCES'].fillna(0).astype(int)
marvel_df = marvel_df.rename(columns={'ID': 'identity'})
marvel_df.fillna('', inplace=True)

Why GridDB?¶

GridDB is a suitable choice for this analysis for the below reasons -

High-performance and scalability: GridDB is designed to handle large-scale data processing with high-speed data ingestion and low-latency data retrieval.
Real-time analytics: GridDB offers real-time analytics capabilities
to enable real-time decision-making and the ability to derive actionable insights from your data in a timely manner.
Integration with other technologies: GridDB offers support for various programming languages and provides APIs for easy integration with different applications and systems. It also supports integration with popular frameworks and tools commonly used in data processing and analytics workflows.

Containers in GridDB¶

GridDB supports the concept of containers. Containers in GridDB are logical containers that can hold data and define the schema for the stored data. They are analogous to tables in a relational database or collections in a NoSQL database.

You can create multiple containers within a GridDB database to organize and store different types of data. Each container can have its own schema, columns, and indexes based on your data requirements. This allows you to efficiently manage and access different types of data within the same GridDB database instance.

By using multiple containers, you can logically separate and structure your data according to your application's needs, making it easier to query, analyze, and manipulate the data independently within each container.

Options to connect to GridDB¶

There are three options to connect to GridDB -

GridDB JDBC Driver
RESTful Web API
GridDB Python Libraries

GridDB JDBC Driver:
- GridDB provides a JDBC (Java Database Connectivity) driver that allows you to connect to GridDB using Java.
- You can use the JDBC driver to establish a connection, execute SQL queries, and perform database operations programmatically.
RESTful Web API:
- GridDB offers a RESTful Web API that allows you to interact with GridDB using HTTP requests.
- You can use standard HTTP methods like GET, POST, PUT, DELETE to perform operations on GridDB.
- This option provides a platform-independent way to connect to GridDB from various programming languages and platforms.
This is the official resource for the WebAPI.
Python Libraries:
- griddb-python: The 'griddb-python' library provides a mechanism to connect to GridDB and perform operations using Python.

Note that the Python JayDeBeApi library can be utilized to connect to GridDB using the GridDB JDBC driver. This allows Python programs to connect to GridDB and run queries using JDBC. In this article, we use Jaydebe API to connect to GridDB.

Establishing the connection to GridDB using Jaydebe API¶

JayDeBeApi is a Python module that enables connecting to databases that support the Java Database Connectivity (JDBC) standard. It acts as a bridge between Python and the database using JDBC, allowing users to execute SQL queries and interact with databases from their Python code. Moreover, JaydebeAPI enables connecting to both a standalone deployment of GridDB or cloud deployment. In this article, we use the GridDB Cloud environment. Please note that GridDB Cloud is currently only available in Japan but it will be available globally in the near-future. If you have a cloud-based GridDB deployment, ensure that you have the necessary information to establish the JDBC connection, such as the JDBC URL, username, and password provided by your cloud service provider. Also make sure you whitelist your IP Address
Refer to GridDB cloud documentation for more information.

The JayDeBeApi library requires the JDBC driver specific to the database you want to connect to. In the case of GridDB, you need to have the GridDB JDBC driver (gridstore-jdbc.jar) installed.

Here are the steps to do so -

Download the GridDB JDBC drivers from the GridDB Cloud portal by accessing the Supports page on the Cloud portal and scrolling down to the "GridDB Cloud Library and Plugin download" section.
Note that the file downloaded is a zip archive. On extracting it, the JDBC driver files can be found within the JDBC folder.
The GridDB JDBC driver files are -

gridstore-5.2.0.jar
gridstore-jdbc-5.2.0.jar
gridstore-advanced-5.2.0.jar

Save all the jar files in the same folder location and in a location accessible by your Python environment.

Add the location of the jar files to the CLASSPATH system environment variable. To do this on a Windows machine, access the 'Environment Variables' from the 'Control Panel'. Under the 'System Variables', create a new variable called 'CLASSPATH' and mention the locations of the 3 jar files.

Install the JayDeBeApi Python package in your Python environment.

You are now ready to connect to the GridDB database from Python.Once the connection is established, you can execute SQL queries and perform database operations using the JayDeBeApi connection object.

It is important to note that the drivers for GridDB Cloud are different from GridDB OSS.

If you get an error at any point, here is a list of error codes to get more context around the error - GridDB Error Codes

Ensure that the SSL Mode is set to 'sslMode=PREFERRED'. Ensure that the connectionRoute is set to PUBLIC.

You can also refer to this GridDB article for more information.

We will use the GridDB notification provider method to connect to GridDB. First, make a note of the notificationProvider, the GridDB cluster name, the GridDB database name and the username/password to access the database. These values will be used to construct the connection string and establish the connection to GridDB.

In [12]:

notification_provider = "https://dbaasshareextconsta.blob.core.windows.net/dbaas-share-extcon-blob/trial1602.json?sv=2015-04-05&sr=b&st=2023-03-14T00%3A00%3A00.0000000Z&se=2073-03-14T00%3A00%3A00.0000000Z&sp=r&sig=h2VJ0xAqsnRsqWV5CAS66RifPIZ1PDCJ0x%2FiXb2FOhA%3D"
np_encode = urllib.parse.quote(notification_provider)

cluster_name = "gs_clustertrial1602" ## Specify the cluster name here
cn_encode = urllib.parse.quote(cluster_name)

database_name = "python_blogs" ## Specify the database name here
dbn_encode = urllib.parse.quote(database_name)

sslMode = "&sslMode=PREFERRED"  #sslMode should be PREFERRED and connectionRoute should be PUBLIC
sm_encode = urllib.parse.quote(sslMode)

username = "Admin"
password = "O6cx2JY1"

#Construct the JDBC URL to be used to connect to the GridDB database. The format is -
# jdbc:gs:///clusterName/databaseName?notificationProvider=theNotificationProviderURL&sslMode=PREFERRED
url = "jdbc:gs:///" + cn_encode +  "/" + dbn_encode + "?notificationProvider=" + np_encode + sm_encode 

#print("JDBC URL is " + url)
os.chdir("/home/israel/development/upwork/GridDB/lib/")
os.environ['CLASSPATH'] = '/home/israel/development/upwork/GridDB/lib'
conn = jaydebeapi.connect("com.toshiba.mwcloud.gs.sql.Driver",
    url, 
    {'user': username, 'password': password,
      'connectionRoute':'PUBLIC'}
    , "gridstore-jdbc.jar")  #ensure to provide the correct location of the gridstore-jdbc JAR library

print('success!')

---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
<ipython-input-12-0458df6b53ce> in <module>
     24     {'user': username, 'password': password,
     25       'connectionRoute':'PUBLIC'}
---> 26     , "gridstore-jdbc.jar")  #ensure to provide the correct location of the gridstore-jdbc JAR library
     27 
     28 print('success!')

~/.local/lib/python3.6/site-packages/jaydebeapi/__init__.py in connect(jclassname, url, driver_args, jars, libs)
    410     else:
    411         libs = []
--> 412     jconn = _jdbc_connect(jclassname, url, driver_args, jars, libs)
    413     return Connection(jconn, _converters)
    414 

~/.local/lib/python3.6/site-packages/jaydebeapi/__init__.py in _jdbc_connect_jpype(jclassname, url, driver_args, jars, libs)
    219             return jpype.JArray(jpype.JByte, 1)(data)
    220     # register driver for DriverManager
--> 221     jpype.JClass(jclassname)
    222     if isinstance(driver_args, dict):
    223         Properties = jpype.java.util.Properties

~/.local/lib/python3.6/site-packages/jpype/_jclass.py in __new__(cls, jc, loader, initialize)
     97 
     98         # Pass to class factory to create the type
---> 99         return _jpype._getClass(jc)
    100 
    101 

TypeError: Class com.toshiba.mwcloud.gs.sql.Driver is not found

You're all set now. The connection established above can be used throughout for DDL and DML process within the database. You are good to use SQL like statements provided by GridDB to create the container and run queries on the same.

If you face any issues with the connection, here are some pointers on what to check -
1. Confirm that you have all 3 GridDB JDBC driver files downloaded and accessible in your system. 2. Ensure that all 3 GridDB JDBC driver files are accessible in the CLASSPATH environment system variable. 3. Ensure to use the correct notificationProvider URL. The notificationProvider URL can be found in the GridDB Cloud Clusters view. 4. Ensure that your IP Address is specified in the exception list maintained on the GridDB Cloud instance. 5. Ensure that your Python environment can access the GridDB JDBC driver files. If you are using an Anaconda environment, ensure to restart the environment after setting up the CLASSPATH environment system variable.

Creating the Containers¶

DC Dataset¶

In [ ]:

sql_query1 = (f"""
    CREATE TABLE DC_Dataset 
        (
        page_id INT,
        name VARCHAR(100),
        urlslug VARCHAR(100),
        identity VARCHAR(20),
        align VARCHAR(20),
        eye VARCHAR(20),
        hair VARCHAR(30),
        sex VARCHAR(25),
        gsm VARCHAR(20),
        alive VARCHAR(20),
        appearances INT,
        first_appearance VARCHAR(20),
        YEAR INT,
        PRIMARY KEY (page_id)
        )
""")

In [ ]:

with conn.cursor() as cursor:
    cursor.execute(sql_query1)

Marvel Dataset¶

In [ ]:

sql_query2 = (f"""
    CREATE TABLE Marvel_Dataset 
        (
        page_id INT,
        name VARCHAR(100),
        urlslug VARCHAR(100),
        identity VARCHAR(20),
        align VARCHAR(20),
        eye VARCHAR(20),
        hair VARCHAR(30),
        sex VARCHAR(25),
        gsm VARCHAR(20),
        alive VARCHAR(20),
        appearances INT,
        first_appearance VARCHAR(20),
        YEAR INT,
        PRIMARY KEY (page_id)
        )
""")

In [ ]:

with conn.cursor() as cursor:
    cursor.execute(sql_query2)

That's it. The containers have been created using SQL create table syntax.

Loading the Containers¶

One of the advantages of using JaydebeAPI and GridDB together is the ability to use GridDB's SQL-like syntaxes. Here is GridDB's SQL Reference.

Loading the Container 'DC_Dataset'¶

In [ ]:

# Prepare the SQL statement for insertion
sql_query2 = "INSERT INTO DC_Dataset (page_id,name,urlslug,identity,align,eye,hair,sex,gsm,alive,appearances,first_appearance,YEAR) VALUES (?,?,?,?,?,?,?,?,?,?,?,?,?)"

cursor = conn.cursor()
for _, row in dc_df.iterrows():
    try:
        # Execute the INSERT statement for each row of data
        with conn.cursor() as cursor:
            cursor.execute(sql_query2, tuple(row))
    except Exception as e:
        # Handle any exceptions that may occur during execution
        print("Error:", e, ' ', row)

# Commit the changes
conn.commit()

Loading the Container 'Marvel_Dataset'¶

In [ ]:

# Prepare the SQL statement for insertion
sql_query3 = "INSERT INTO Marvel_Dataset (page_id,name,urlslug,identity,align,eye,hair,sex,gsm,alive,appearances,first_appearance,Year) VALUES (?,?,?,?,?,?,?,?,?,?,?,?,?)"

cursor = conn.cursor()
for _, row in marvel_df.iterrows():
    try:
        # Execute the INSERT statement for each row of data
        with conn.cursor() as cursor:
            cursor.execute(sql_query3, tuple(row))
    except Exception as e:
        # Handle any exceptions that may occur during execution
        print("Error:", e, ' ', row)

# Commit the changes
conn.commit()

Visualization & Analysis of the Data in GridDB¶

How many Characters are alive and how many are dead in the DC Universe?¶

In [ ]:

sql_query4 = """
    SELECT CASE WHEN alive = '' THEN 'Not Known' ELSE alive END AS Living_Status, count(alive) as num_characters
    FROM DC_Dataset
    GROUP BY Living_Status
"""

In [ ]:

cursor = conn.cursor()
cursor.execute(sql_query4)
results = cursor.fetchall()

# Convert the query results to a DataFrame
alive_dead_dc_df = pd.DataFrame(results, columns=['alive', 'num_characters'])

In [ ]:

# Data for the pie plot
labels = alive_dead_dc_df['alive']
sizes = alive_dead_dc_df['num_characters']

# Create the pie plot
plt.pie(sizes, labels=labels, autopct='%1.2f%%', startangle=90)

# Set aspect ratio to be equal so that pie is drawn as a circle
plt.axis('equal')

# Set a title for the plot
plt.title('DC Universe - Distribution of Alive and Dead Characters')

# Display the plot
plt.show()

Insight(s): Around 75% of the characters in the DC world are alive while 25% of the characters are dead.There are some characters whose living status is not yet clear (0.04%).

Now, let's see how many in the Marvel World are alive and how many are dead.

How many Characters are alive and how many are dead in the Marvel Universe?¶

In [ ]:

sql_query5 = """
    SELECT CASE WHEN alive = '' THEN 'Not Known' ELSE alive END AS Living_Status, count(alive) as num_characters
    FROM Marvel_Dataset
    GROUP BY Living_Status
"""

In [ ]:

cursor = conn.cursor()
cursor.execute(sql_query5)
results = cursor.fetchall()

# Convert the query results to a DataFrame
alive_dead_marvel_df = pd.DataFrame(results, columns=['alive', 'num_characters'])

In [ ]:

# Data for the pie plot
labels = alive_dead_marvel_df['alive']
sizes = alive_dead_marvel_df['num_characters']

# Create the pie plot
plt.pie(sizes, labels=labels, autopct='%1.2f%%', startangle=90)

# Set aspect ratio to be equal so that pie is drawn as a circle
plt.axis('equal')

# Set a title for the plot
plt.title('Marvel Universe - Distribution of Alive and Dead Characters')

# Display the plot
plt.show()

Insight(s): About 77% of the characters in the Marvel Universe are alive while 23% of the characters are dead.There are some characters whose living status is not yet clear (0.02%).

What is the Gender Distribution of Characters in Marvel and DC Universes?¶

In [ ]:

# Create a cursor to execute SQL statements
cursor = conn.cursor()

# Execute SELECT queries to count characters by sex in each container
sql_query_marvel = """
    SELECT CASE WHEN Sex = '' THEN 'Not Available' ELSE Sex END as Gender, COUNT(*) as num_characters
    FROM Marvel_Dataset
    GROUP BY Sex
    """
cursor.execute(sql_query_marvel)
result_marvel = cursor.fetchall()

sql_query_dc = """
    SELECT CASE WHEN Sex = '' THEN 'Not Available' ELSE Sex END as Gender, COUNT(*) as num_characters
    FROM DC_Dataset
    GROUP BY Sex
    """
cursor.execute(sql_query_dc)
result_dc = cursor.fetchall()

# Separate the sexes and counts from the Marvel and DC results
sexes_marvel = [row[0] for row in result_marvel]
counts_marvel = [row[1] for row in result_marvel]

sexes_dc = [row[0] for row in result_dc]
counts_dc = [row[1] for row in result_dc]

# Create a wider figure with a larger width
plt.figure(figsize=(17, 6))

# Generate unique colors for 'Marvel' and 'DC'
colors = ['tab:blue', 'tab:red']

# Create the Marvel subplot
plt.subplot(1, 2, 1)
bars_marvel = plt.barh(sexes_marvel, counts_marvel, color=colors[0])
plt.xlabel('Number of Characters')
plt.ylabel('Sex')
plt.title('Marvel Gender Distribution')

# Display values on the bars in the Marvel subplot
for bar in bars_marvel:
    width = bar.get_width()
    plt.text(width, bar.get_y() + bar.get_height() / 2, width, ha='left', va='center')

# Create the DC subplot
plt.subplot(1, 2, 2)
bars_dc = plt.barh(sexes_dc, counts_dc, color=colors[1])
plt.xlabel('Number of Characters')
plt.title('DC Gender Distribution')

# Display values on the bars in the DC subplot
for bar in bars_dc:
    width = bar.get_width()
    plt.text(width, bar.get_y() + bar.get_height() / 2, width, ha='left', va='center')

plt.subplots_adjust(left=None, bottom=None, right=None, top=None, wspace=0.5, hspace=None)

plt.suptitle('Marvel vs DC Gender Distribution', fontsize=16, fontweight='bold')

plt.show()

Insight(s):

It is interesting to note that the Marvel Universe has significantly more male characters than the DC Universe.
Both DC and Marvel have characters across different genders thereby representing gender diversity fairly well.

From Secret to Public: Decoding Character Identities in DC and Marvel¶

Let's look at some interesting stats here to understand how many characters are secret identities Vs how many have an identity that is known to the public.

In [ ]:

# Create a cursor to execute SQL statements
cursor = conn.cursor()

# Execute SELECT queries to count characters by sex in each container
sql_query_marvel = """
    SELECT 'Marvel',CASE WHEN identity = '' THEN 'Not Available' ELSE identity END as identity, COUNT(*) as num_characters
    FROM Marvel_Dataset
    GROUP BY 1,2
    UNION ALL
    SELECT 'DC',CASE WHEN identity = '' THEN 'Not Available' ELSE identity END as Gender, COUNT(*) as num_characters
    FROM DC_Dataset
    GROUP BY 1,2
    """
cursor.execute(sql_query_marvel)
identity_data = cursor.fetchall()

In [ ]:

# Extract data for DC and Marvel separately
dc_data = [(identity, count) for universe, identity, count in identity_data if universe == 'DC']
marvel_data = [(identity, count) for universe, identity, count in identity_data if universe == 'Marvel']

# Create subplots
fig, (ax1, ax2) = plt.subplots(1, 2, figsize=(15, 6))

# Plot for DC
bars_dc = ax1.barh([x[0] for x in dc_data], [x[1] for x in dc_data], color='blue')
ax1.set_xlabel('Count')
ax1.set_ylabel('Identity')
ax1.set_title('DC Identity Distribution')

# Display values on the bars in the DC subplot
for bar in bars_dc:
    width = bar.get_width()
    ax1.text(width, bar.get_y() + bar.get_height() / 2, width, ha='left', va='center')

# Plot for Marvel
bars_marvel = ax2.barh([x[0] for x in marvel_data], [x[1] for x in marvel_data], color='red')
ax2.set_xlabel('Count')
ax2.set_ylabel('Identity')
ax2.set_title('Marvel Identity Distribution')

# Display values on the bars in the Marvel subplot
for bar in bars_marvel:
    width = bar.get_width()
    ax2.text(width, bar.get_y() + bar.get_height() / 2, width, ha='left', va='center')

plt.subplots_adjust(left=None, bottom=None, right=None, top=None, wspace=0.5, hspace=None)

plt.suptitle('Marvel vs DC - Exploring Identities', fontsize=16, fontweight='bold')

# Show the plot
plt.show()

Insight(s):

From the above plot, it is clear that Marvel has more characters with a secrety identity than DC.
In the context of Marvel characters, the term "Known to Authorities" identity refers to a character whose true identity is known and recognized by government or law enforcement agencies within the Marvel Universe. This status typically indicates that the character's secret identity or alter ego is publicly known to certain official entities. Marvel has 15 characters with this status
The term "No Dual Identity" refers to a character who does not have a secret or alter ego. These characters typically operate solely under their superhero or supervillain identities without concealing their true identities behind a civilian persona. Marvel has 1788 characters without a dual identity.

Physical traits in each of the Marvel & DC universes¶

In [ ]:

# Create a cursor to execute SQL statements
cursor = conn.cursor()

# Execute SELECT queries to count characters by sex in each container
sql_query_traits = """
    SELECT 'Marvel',
    CASE WHEN eye = '' THEN 'Not Known' ELSE eye END as eye,
    CASE WHEN hair = '' THEN 'Not Known' ELSE hair END as hair,
    COUNT(*) as num_characters
    FROM Marvel_Dataset
    GROUP BY 1,2
    UNION ALL
    SELECT 'DC',
    CASE WHEN eye = '' THEN 'Not Known' ELSE eye END as eye, 
    CASE WHEN hair = '' THEN 'Not Known' ELSE hair END as hair,
    COUNT(*) as num_characters
    FROM DC_Dataset
    GROUP BY 1,2
    order by 4 desc
    """
cursor.execute(sql_query_marvel)
physicaltraits_data = cursor.fetchall()

In [ ]:

physicaltraits_df = pd.DataFrame(physicaltraits_data, columns=['Category', 'Eye_Color', 'Hair_Color','Cnt'])

In [ ]:

# Assuming you have the DataFrame named top10_physical_traits_df with the provided data

# Sort the DataFrame in descending order by the count column
sorted_data = physicaltraits_df.sort_values(by='Cnt', ascending=False)

# Filter the sorted DataFrame for DC and Marvel categories separately
dc_data = sorted_data[sorted_data['Category'] == 'DC']
marvel_data = sorted_data[sorted_data['Category'] == 'Marvel']

#dc_data
#marvel_data

In [ ]:

# Assuming you have the DataFrame named top10_physical_traits_df with the provided data

# Sort the DataFrame in descending order by the count column
sorted_data = physicaltraits_df.sort_values(by='Cnt', ascending=True)

# Filter the sorted DataFrame for DC and Marvel categories separately
dc_data = sorted_data[sorted_data['Category'] == 'DC']
marvel_data = sorted_data[sorted_data['Category'] == 'Marvel']



# Create a figure with two subplots
fig, (ax1, ax2) = plt.subplots(1, 2, figsize=(12, 6))

# Plot for DC category
bars_dc = ax1.barh(dc_data['Eye_Color'] + ' | ' + dc_data['Hair_Color'], dc_data['Cnt'])
#sorted_bars_dc = [bar for _, bar in sorted(zip(dc_data['Cnt'], bars_dc), reverse=True)]
ax1.set_xlabel('Count')
ax1.set_ylabel('Eye Color | Hair Color')
ax1.set_title('Top 10 Physical Traits - DC Category')


for bar in bars_dc:
    width = bar.get_width()
    ax1.text(width, bar.get_y() + bar.get_height() / 2, int(width), ha='left', va='center')


# Plot for Marvel category
bars_marvel = ax2.barh(marvel_data['Eye_Color'] + ' | ' + marvel_data['Hair_Color'], marvel_data['Cnt'])
#sorted_bars_marvel = [bar for _, bar in sorted(zip(marvel_data['Cnt'], bars_marvel), reverse=True)]
ax2.set_xlabel('Count')
ax2.set_ylabel('Eye Color | Hair Color')
ax2.set_title('Top 10 Physical Traits - Marvel Category')


for bar in bars_marvel:
    width = bar.get_width()
    ax2.text(width, bar.get_y() + bar.get_height() / 2, int(width), ha='left', va='center')


# Rotate the x-axis tick labels for better readability
ax1.tick_params(axis='y', rotation=30)
ax2.tick_params(axis='y', rotation=30)

plt.subplots_adjust(wspace=0.5)

plt.suptitle('Top 10 Physical Traits - Marvel Vs DC', fontsize=16, fontweight='bold')

# Show the plot
plt.show()

Realtime Event Tracking using Spring...

Superhero Showdown: Analyzing Marvel and...

Building an OpenAI API Tokens...

Soccer Players Recommendation System Using...

Superhero Showdown: Analyzing Marvel and DC Data with GridDB

Packages required¶

Overview¶

Loading the data into a dataframe and Data Cleaning¶

Loading the DC Dataframe¶

Loading the Marvel Dataframe¶

Why GridDB?¶

Containers in GridDB¶

Options to connect to GridDB¶

Establishing the connection to GridDB using Jaydebe API¶

Creating the Containers¶

DC Dataset¶

Marvel Dataset¶

Loading the Containers¶

Loading the Container 'DC_Dataset'¶

Loading the Container 'Marvel_Dataset'¶

Visualization & Analysis of the Data in GridDB¶

How many Characters are alive and how many are dead in the DC Universe?¶

How many Characters are alive and how many are dead in the Marvel Universe?¶

What is the Gender Distribution of Characters in Marvel and DC Universes?¶

From Secret to Public: Decoding Character Identities in DC and Marvel¶

Physical traits in each of the Marvel & DC universes¶