{"id":220,"date":"2021-01-25T13:19:52","date_gmt":"2021-01-25T13:19:52","guid":{"rendered":"https:\/\/www.kindsonthegenius.com\/data-science\/?p=220"},"modified":"2021-01-25T14:55:58","modified_gmt":"2021-01-25T14:55:58","slug":"working-with-data-json-pandas-dataframe-with-python-useful-tipcs","status":"publish","type":"post","link":"https:\/\/www.kindsonthegenius.com\/data-science\/working-with-data-json-pandas-dataframe-with-python-useful-tipcs\/","title":{"rendered":"Working With Data, Json, Pandas DataFrame with Python – Useful Tips"},"content":{"rendered":"

In this tutorial, we would cover how to do the following<\/p>\n

    \n
  1. Import JSON Data to Python<\/a><\/li>\n
  2. Building a Pandas Dataframe<\/a><\/li>\n
  3. Adding Rows to Dataframe<\/a><\/li>\n
  4. Displaying a Formatted Table<\/a><\/li>\n
  5. Using Dataframe iloc[]<\/a><\/li>\n<\/ol>\n

     <\/p>\n

    1. Import JSON Data to Python<\/strong><\/h4>\n

    Let’s first get some sample json file t work with. You can get same json file from here https:\/\/jsonplaceholder.typicode.com\/<\/a>. I have downloaded a json file to my local system. I believe you already have Jupiter Notebook. So the first\u00a0 you need to to do is to start a new notebook.<\/p>\n

    To be able to import json file, you need the json module and then use the load method. The code is shown below<\/p>\n

    # How to import json in Python<\/span>\r\nimport<\/span> json<\/span>\r\n\r\nwith<\/span> open<\/span>('\/Users\/kindsonmunonye\/todos.json'<\/span>) as<\/span> f:\r\n  data =<\/span> json.<\/span>load(f)\r\n<\/pre>\n
    The data is imported and save in a variable called data. You can use the command print(data)<\/em> to display the data.<\/p>\n
     <\/p>\n
    2. Building a Pandas Dataframe<\/strong><\/h4>\n
    If you’ll be working with data in Python, then you’ll most likely need to have the data in Pandas Dataframe. This is basically a tabular representation of the data with rows and columns. So let’s assume you want to create the following dataframe in Python<\/p>\n\n\n\n\n\n\n
    Name<\/td>\nAge<\/td>\nHeight<\/td>\n<\/tr>\n
    Kindson<\/td>\n39<\/td>\n185<\/td>\n<\/tr>\n
    Jadon<\/td>\n30<\/td>\n170<\/td>\n<\/tr>\n
    Solace<\/td>\n14<\/td>\n155<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n
    The code below creates the DataFrame<\/p>\n
    import<\/span> pandas<\/span> as<\/span> pd<\/span>\r\ndf =<\/span> pd.<\/span>DataFrame(columns=<\/span>[\"name\"<\/span>, \"age\"<\/span>, \"height\"<\/span>])\r\n<\/pre>\n
    But right now the dataframe is empty!<\/p>\n
     <\/p>\n
    3. Adding Rows to Pandas Dataframe<\/strong><\/h4>\n
    Adding Rows to Dataframe using loc[]<\/strong><\/h5>\n
    To add rows, you use the loc<\/em> property of the dataframe. The code below populates the dataframe<\/p>\n
    df.<\/span>loc[0<\/span>] =<\/span> [\"Kindson\"<\/span>, 43<\/span>, 80<\/span>]\r\ndf.<\/span>loc[1<\/span>] =<\/span> [\"Jadon\"<\/span>, 30<\/span>, 170<\/span>]\r\ndf.<\/span>loc[2<\/span>] =<\/span> [\"Solace\"<\/span>, 14<\/span>, 155<\/span>]\r\n<\/pre>\n
    Now if you display the dataframe, you will have:<\/p>\n
    \"Displaying<\/a>
    Displaying a dataframe<\/figcaption><\/figure>\n
     <\/p>\n
    Adding Rows Using Dataframe.append()<\/strong><\/p>\n
    the append method provide a way to add items rows to the dataframe without worrying about the row index. For instance, the code below adds two new rows to the dataframe<\/p>\n
    df.<\/span>append({\"name\"<\/span>: \"McMills\"<\/span>, \"age\"<\/span>:14<\/span>, \"height\"<\/span>: 74<\/span>}, ignore_index=<\/span>True<\/span>)\r\ndf.<\/span>append({\"name\"<\/span>: \"Adaoma\"<\/span>, \"age\"<\/span>:20<\/span>, \"height\"<\/span>: 89<\/span>}, ignore_index=<\/span>True<\/span>)\r\n<\/pre>\n
    If you run this, the you will see that two new rows are added to the dataframe as shown below:<\/p>\n
    \"Adding<\/a>
    Adding row to dataframe using append<\/figcaption><\/figure>\n
     <\/p>\n
    4. Displaying a Formatted Table<\/strong><\/h4>\n
    Sometimes, when you import data into Python, and display it using the print() method, it is not displayed in nice tabular format. To fix this, you need to us the display module available in the IPython.display library.<\/p>\n
    This code below imports the display module, then you can use display(data) instead of print(data) to display your data.<\/p>\n
    from<\/span> IPython.display<\/span> import<\/span> display \r\n<\/pre>\n
    <\/h4>\n
    5. How to Use iloc[]<\/strong><\/h4>\n
    You will need to use iloc[]<\/em> for selecting subsets of some data or from a dataframe.<\/p>\n
    You need to specify the rows you want to select and the columns you want to select as well. The syntax is:<\/p>\n
    df.<\/span>iloc[row_range, col_range]\r\n<\/pre>\n
    Here are some examples:<\/p>\n