Normalizing State Shape

Many applications deal with data that is nested or relational in nature. For example, a blog editor could have many Posts, each Post could have many Comments, and both Posts and Comments would be written by a User. Data for this kind of application might look like:

  1. const blogPosts = [
  2.   {
  3.     id: 'post1',
  4.     author: { username: 'user1', name: 'User 1' },
  5.     body: '......',
  6.     comments: [
  7.       {
  8.         id: 'comment1',
  9.         author: { username: 'user2', name: 'User 2' },
  10.         comment: '.....'
  11.       },
  12.       {
  13.         id: 'comment2',
  14.         author: { username: 'user3', name: 'User 3' },
  15.         comment: '.....'
  16.       }
  17.     ]
  18.   },
  19.   {
  20.     id: 'post2',
  21.     author: { username: 'user2', name: 'User 2' },
  22.     body: '......',
  23.     comments: [
  24.       {
  25.         id: 'comment3',
  26.         author: { username: 'user3', name: 'User 3' },
  27.         comment: '.....'
  28.       },
  29.       {
  30.         id: 'comment4',
  31.         author: { username: 'user1', name: 'User 1' },
  32.         comment: '.....'
  33.       },
  34.       {
  35.         id: 'comment5',
  36.         author: { username: 'user3', name: 'User 3' },
  37.         comment: '.....'
  38.       }
  39.     ]
  40.   }
  41.   // and repeat many times
  42. ]

Notice that the structure of the data is a bit complex, and some of the data is repeated. This is a concern for several reasons:

  • When a piece of data is duplicated in several places, it becomes harder to make sure that it is updated appropriately.
  • Nested data means that the corresponding reducer logic has to be more nested and therefore more complex. In particular, trying to update a deeply nested field can become very ugly very fast.
  • Since immutable data updates require all ancestors in the state tree to be copied and updated as well, and new object references will cause connected UI components to re-render, an update to a deeply nested data object could force totally unrelated UI components to re-render even if the data they're displaying hasn't actually changed.
    Because of this, the recommended approach to managing relational or nested data in a Redux store is to treat a portion of your store as if it were a database, and keep that data in a normalized form.

Designing a Normalized State

The basic concepts of normalizing data are:

  • Each type of data gets its own "table" in the state.
  • Each "data table" should store the individual items in an object, with the IDs of the items as keys and the items themselves as the values.
  • Any references to individual items should be done by storing the item's ID.
  • Arrays of IDs should be used to indicate ordering.
    An example of a normalized state structure for the blog example above might look like:
  1. {
  2.     posts : {
  3.         byId : {
  4.             "post1" : {
  5.                 id : "post1",
  6.                 author : "user1",
  7.                 body : "......",
  8.                 comments : ["comment1", "comment2"]
  9.             },
  10.             "post2" : {
  11.                 id : "post2",
  12.                 author : "user2",
  13.                 body : "......",
  14.                 comments : ["comment3", "comment4", "comment5"]
  15.             }
  16.         },
  17.         allIds : ["post1", "post2"]
  18.     },
  19.     comments : {
  20.         byId : {
  21.             "comment1" : {
  22.                 id : "comment1",
  23.                 author : "user2",
  24.                 comment : ".....",
  25.             },
  26.             "comment2" : {
  27.                 id : "comment2",
  28.                 author : "user3",
  29.                 comment : ".....",
  30.             },
  31.             "comment3" : {
  32.                 id : "comment3",
  33.                 author : "user3",
  34.                 comment : ".....",
  35.             },
  36.             "comment4" : {
  37.                 id : "comment4",
  38.                 author : "user1",
  39.                 comment : ".....",
  40.             },
  41.             "comment5" : {
  42.                 id : "comment5",
  43.                 author : "user3",
  44.                 comment : ".....",
  45.             },
  46.         },
  47.         allIds : ["comment1", "comment2", "comment3", "commment4", "comment5"]
  48.     },
  49.     users : {
  50.         byId : {
  51.             "user1" : {
  52.                 username : "user1",
  53.                 name : "User 1",
  54.             },
  55.             "user2" : {
  56.                 username : "user2",
  57.                 name : "User 2",
  58.             },
  59.             "user3" : {
  60.                 username : "user3",
  61.                 name : "User 3",
  62.             }
  63.         },
  64.         allIds : ["user1", "user2", "user3"]
  65.     }
  66. }

This state structure is much flatter overall. Compared to the original nested format, this is an improvement in several ways:

  • Because each item is only defined in one place, we don't have to try to make changes in multiple places if that item is updated.
  • The reducer logic doesn't have to deal with deep levels of nesting, so it will probably be much simpler.
  • The logic for retrieving or updating a given item is now fairly simple and consistent. Given an item's type and its ID, we can directly look it up in a couple simple steps, without having to dig through other objects to find it.
  • Since each data type is separated, an update like changing the text of a comment would only require new copies of the "comments > byId > comment" portion of the tree. This will generally mean fewer portions of the UI that need to update because their data has changed. In contrast, updating a comment in the original nested shape would have required updating the comment object, the parent post object, the array of all post objects, and likely have caused all of the Post components and Comment components in the UI to re-render themselves.
    Note that a normalized state structure generally implies that more components are connected and each component is responsible for looking up its own data, as opposed to a few connected components looking up large amounts of data and passing all that data downwards. As it turns out, having connected parent components simply pass item IDs to connected children is a good pattern for optimizing UI performance in a React Redux application, so keeping state normalized plays a key role in improving performance.

Organizing Normalized Data in State

A typical application will likely have a mixture of relational data and non-relational data. While there is no single rule for exactly how those different types of data should be organized, one common pattern is to put the relational "tables" under a common parent key, such as "entities". A state structure using this approach might look like:

  1. {
  2.     simpleDomainData1: {....},
  3.     simpleDomainData2: {....},
  4.     entities : {
  5.         entityType1 : {....},
  6.         entityType2 : {....}
  7.     },
  8.     ui : {
  9.         uiSection1 : {....},
  10.         uiSection2 : {....}
  11.     }
  12. }

This could be expanded in a number of ways. For example, an application that does a lot of editing of entities might want to keep two sets of "tables" in the state, one for the "current" item values and one for the "work-in-progress" item values. When an item is edited, its values could be copied into the "work-in-progress" section, and any actions that update it would be applied to the "work-in-progress" copy, allowing the editing form to be controlled by that set of data while another part of the UI still refers to the original version. "Resetting" the edit form would simply require removing the item from the "work-in-progress" section and re-copying the original data from "current" to "work-in-progress", while "applying" the edits would involve copying the values from the "work-in-progress" section to the "current" section.

Relationships and Tables

Because we're treating a portion of our Redux store as a "database", many of the principles of database design also apply here as well. For example, if we have a many-to-many relationship, we can model that using an intermediate table that stores the IDs of the corresponding items (often known as a "join table" or an "associative table"). For consistency, we would probably also want to use the same byId and allIds approach that we used for the actual item tables, like this:

  1. {
  2.     entities: {
  3.         authors : { byId : {}, allIds : [] },
  4.         books : { byId : {}, allIds : [] },
  5.         authorBook : {
  6.             byId : {
  7.                 1 : {
  8.                     id : 1,
  9.                     authorId : 5,
  10.                     bookId : 22
  11.                 },
  12.                 2 : {
  13.                     id : 2,
  14.                     authorId : 5,
  15.                     bookId : 15,
  16.                 },
  17.                 3 : {
  18.                     id : 3,
  19.                     authorId : 42,
  20.                     bookId : 12
  21.                 }
  22.             },
  23.             allIds : [1, 2, 3]
  25.         }
  26.     }
  27. }

Operations like "Look up all books by this author", can then be accomplished easily with a single loop over the join table. Given the typical amounts of data in a client application and the speed of Javascript engines, this kind of operation is likely to have sufficiently fast performance for most use cases.

Normalizing Nested Data

Because APIs frequently send back data in a nested form, that data needs to be transformed into a normalized shape before it can be included in the state tree. The Normalizr library is usually used for this task. You can define schema types and relations, feed the schema and the response data to Normalizr, and it will output a normalized transformation of the response. That output can then be included in an action and used to update the store. See the Normalizr documentation for more details on its usage.