Menu
The Chia Plot
  • Blog
  • How-To
  • About
  • Contact
  • Security
  • Discord
The Chia Plot
datacenter

Chia Database upgrade – process and results

Posted on February 11, 2022February 11, 2022 by Chris Dupres

One of the biggest upgrades in the recent Chia Blockchain 1.3 beta that was just released is the ability to upgrade the v1 Chia Database to v2. The promise here was pretty extreme with Chia promising “approximately 45%” space reduction. That’s quite the promise, so let’s see if it holds up.

First, don’t do this on your main farming rig. I have no idea what edge cases might cause catastrophic issues. But for those willing to take the risk, the process is pretty simple. Just open up a terminal or command prompt, navigate to your Chia CLI in ~\chia-blockchain\app-1.2.12269\resources\app.asar.unpacked\daemon (Windows) and type out chia db upgrade. That will kick it off.

chia database upgrade
chia database upgrade

The process is very IO intensive, but not particularly hard on the CPU or memory. It runs while your farming runs and didn’t seem to cause any issues for me. I am having an unrelated issue due to the upgrade involving my plot NFTs not getting picked up properly, but that was not related to the DB upgrade. It didn’t fix it either though.

finished chia database upgrade
finished chia database upgrade

The process took about 37 minutes total and when it was done it left both DB images, so you will have to manually clean up. It runs over 5 phases, each copying a specific section of the database. And what are the results? See for yourself.

final chia database sizes
final chia database sizes

Its about 45%. The process reduced my DB from just under 50GB to just under 27GB. This is fantastic and makes farming to small single board computers like the Raspberry Pi possible again. I haven’t made any performance measurements so I have no idea if the new database format lives up to the modest improvements yet, but we should see soon if my farm is out of sync constantly. But I doubt it. Great work, Chia Network.

Related

13 thoughts on “Chia Database upgrade – process and results”

  1. Fik says:
    February 16, 2022 at 9:01 am

    What is the relation of this smaller Chia v2 database and the BlueBox compression project? They both aim at smaller DB files, right?

    Reply
  2. Tomasz Szymański says:
    February 20, 2022 at 4:48 am

    I got the latest chia version on Ubuntu (1.2.12.dev1+gf2a334efb), but when I try to use command to convert database to new version, I got Error: No such command ‘db’. What can I do?

    Reply
    1. Fik says:
      February 20, 2022 at 6:19 am

      You need version 1.3 currently in Beta.

      Reply
  3. Roy says:
    March 14, 2022 at 12:50 pm

    What changes need to be made to config.yaml for the wallet after the chia db upgrade? it still points to v1

    Reply
    1. Fik says:
      March 15, 2022 at 1:51 am

      I’ve changed it to v2 for wallet as well. I’m not sure, if it is necessary though.

      Reply
  4. Anonymous says:
    March 18, 2022 at 2:31 pm

    My database upgrade took “forever”… Over 24 hours!

    I upgrade directly on my farming machine which is a Raspberry Pi 4 with 4GB RAM, an SSD for the Chia database and 4GB swap space on the SSD.

    Not sure why it took so much longer than yours but in the end it finished… Farming in parallel went smoothly the whole time (no stale partials), except around 1 hour before the end where my farmer suddenly went offline.

    For anyone interessted, here is my upgrade log:

    opening file for reading: /mnt/ssd/.chia/mainnet/db/blockchain_v1_mainnet.sqlite
    opening file for writing: /mnt/ssd/.chia/mainnet/db/blockchain_v2_mainnet.sqlite
    initializing v2 version
    initializing v2 block store
    peak: ca4351781d8b28e784e4d0dacdd994c505e93602a6d93e3dc6d9dbd7e62ea862 height: 1707861
    [1/5] converting full_blocks
    5791.56 seconds
    [2/5] converting sub_epoch_segments_v3
    499.42 seconds
    [3/5] converting hint_store
    350.51 seconds
    [4/5] converting coin_store
    77411.60 seconds
    [5/5] build indices
    block store
    coin store
    hint store
    4854.99 seconds
    updating config.yaml
    database_path: db/blockchain_v2_CHALLENGE.sqlite

    LEAVING PREVIOUS DB FILE UNTOUCHED /mnt/ssd/.chia/mainnet/db/blockchain_v1_mainnet.sqlite

    Reply
  5. Rob says:
    March 20, 2022 at 12:27 pm

    Bless you for posting this in a format that is not a Youtube video. I do not need a bloody video to tell me how to run one command. You have a new fan and follower.

    Reply
  6. Werther595 says:
    March 26, 2022 at 6:06 pm

    When you say you’ll have to manually clean up, could you elaborate? Is is just deleting the one file (blockchain_v1_mainnet.sqlite)?

    Reply
    1. Fik says:
      March 27, 2022 at 4:06 am

      You can actually delete two files, one db/blockchain_v1_mainnet.sqlite and second one wallet/db/blockchain_wallet_v1_mainnet_xxxxxx.sqlite.

      Reply
  7. OMG says:
    April 2, 2022 at 6:57 pm

    Could you please advise how to upgrate db on Mac?

    Reply
  8. Daniel R Watkins says:
    April 8, 2022 at 8:12 pm

    How is your new database so small? Mine was about 105 GB probably partially because it was so old it had some garbage in it. So I deleted the database and wallet directory in my installation and then restarted the client, running 1.3.3. It then rebuilt the database in 3 days. Now the database file size is about 65 gb. How is yours so much smaller than mine? Granted this article was written a few weeks ago so obviously yours is larger now but not that big??

    Reply
    1. Daniel R Watkins says:
      April 8, 2022 at 8:13 pm

      I mean your article was written 2 months ago, but still.

      Reply
      1. Dave says:
        June 21, 2022 at 3:27 pm

        because he is using V2 update your database it will be half the size at least

        Reply

Leave a Reply Cancel reply

Advertisement

Recent Posts

  • Crypto is burning down – Chia seems fine
  • Chia CAT upgrade fiasco part 2 – Was I wrong?
  • WTF just happened?? CAT1 to CAT2 “upgrade”
  • The era of the Chia NFT is upon us
  • Chia Blockchain 1.4.0 released – NFTs and DIDs oh my
  • Discussion
  • Facts About Farmers
  • How-To
  • Information
  • News
  • pools
  • Security
  • Trademark
  • Trading
  • Uncategorized

Dark Mode Switch

©2021 The Chia Plot - Donate XCH / MRMT / SBX @ xch1p4440d6zwu9ryta2vx073lq2ge3s29d37kskz6t34jp085e8srjqnk0gcr
We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept All”, you consent to the use of ALL the cookies. However, you may visit "Cookie Settings" to provide a controlled consent.
Cookie SettingsAccept All
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-advertisement1 yearThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Advertisement".
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
JSESSIONIDsessionUsed by sites written in JSP. General purpose platform session cookies that are used to maintain users' state across page requests.
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
CookieDurationDescription
na_id1 year 1 monthThis cookie is set by Addthis.com to enable sharing of links on social media platforms like Facebook and Twitter
na_rn1 monthThis cookie is used to recognize the visitor upon re-entry. This cookie allows to collect information on user behaviour and allows sharing function provided by Addthis.com
na_sc_e1 monthThis cookie is used to recognize the visitor upon re-entry. This cookie allows to collect information on user behaviour and allows sharing function provided by Addthis.com
na_sr1 monthThis cookie is set by Addthis.com. This cookie is used for sharing of links on social media platforms.
na_srp1 minuteThis cookie is used to recognize the visitor upon re-entry. This cookie allows to collect information on user behaviour and allows sharing function provided by Addthis.com
na_tc1 year 1 monthThis cookie is set by the provider Addthis. This cookie is used for social media sharing tracking service.
ouid1 year 1 monthThe cookie is set by Addthis which enables the content of the website to be shared across different networking and social sharing websites.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
CookieDurationDescription
d3 monthsThis cookie tracks anonymous information on how visitors use the website.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
CookieDurationDescription
__gads1 year 24 daysThis cookie is set by Google and stored under the name dounleclick.com. This cookie is used to track how many times users see a particular advert which helps in measuring the success of the campaign and calculate the revenue generated by the campaign. These cookies can only be read from the domain that it is set on so it will not track any data while browsing through another sites.
_ga2 yearsThis cookie is installed by Google Analytics. The cookie is used to calculate visitor, session, campaign data and keep track of site usage for the site's analytics report. The cookies store information anonymously and assign a randomly generated number to identify unique visitors.
_gat_gtag_UA_199099757_11 minuteThis cookie is set by Google and is used to distinguish users.
_gid1 dayThis cookie is installed by Google Analytics. The cookie is used to store information of how visitors use a website and helps in creating an analytics report of how the website is doing. The data collected including the number visitors, the source where they have come from, and the pages visted in an anonymous form.
CONSENT16 years 4 months 5 daysThese cookies are set via embedded youtube-videos. They register anonymous statistical data on for example how many times the video is displayed and what settings are used for playback.No sensitive data is collected unless you log in to your google account, in that case your choices are linked with your account, for example if you click “like” on a video.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
CookieDurationDescription
advanced_ads_browser_width1 monthThis cookie is set by Advanced ads plugin.This cookie is used to measure and store the user browser width for adverts.
anj3 monthsNo description available.
CMID1 yearThe cookie is set by CasaleMedia. The cookie is used to collect information about the usage behavior for targeted advertising.
CMPRO3 monthsThis cookie is set by Casalemedia and is used for targeted advertisement purposes.
CMPS3 monthsThis cookie is set by Casalemedia and is used for targeted advertisement purposes.
CMRUM31 yearThis cookie is set by Casalemedia and is used for targeted advertisement purposes.
CMST1 dayThe cookie is set by CasaleMedia. The cookie is used to collect information about the usage behavior for targeted advertising.
DSID1 hourThis cookie is setup by doubleclick.net. This cookie is used by Google to make advertising more engaging to users and are stored under doubleclick.net. It contains an encrypted unique ID.
i1 yearThe purpose of the cookie is not known yet.
IDE1 year 24 daysUsed by Google DoubleClick and stores information about how the user uses the website and any other advertisement before visiting the website. This is used to present users with ads that are relevant to them according to the user profile.
KADUSERCOOKIE3 monthsThe cookie is set by pubmatic.com for identifying the visitors' website or device from which they visit PubMatic's partners' website.
KTPCACOOKIE1 dayThis cookie is set by pubmatic.com for the purpose of checking if third-party cookies are enabled on the user's website.
mc1 year 1 monthThis cookie is associated with Quantserve to track anonymously how a user interact with the website.
test_cookie15 minutesThis cookie is set by doubleclick.net. The purpose of the cookie is to determine if the user's browser supports cookies.
uid1 year 1 monthThis cookie is used to measure the number and behavior of the visitors to the website anonymously. The data includes the number of visits, average duration of the visit on the website, pages visited, etc. for the purpose of better understanding user preferences for targeted advertisments.
uuid3 monthsTo optimize ad relevance by collecting visitor data from multiple websites such as what pages have been loaded.
uuid23 monthsThis cookies is set by AppNexus. The cookies stores information that helps in distinguishing between devices and browsers. This information us used to select advertisements served by the platform and assess the performance of the advertisement and attribute payment for those advertisements.
VISITOR_INFO1_LIVE5 months 27 daysThis cookie is set by Youtube. Used to track the information of the embedded YouTube videos on a website.
YSCsessionThis cookies is set by Youtube and is used to track the views of embedded videos.
yt-remote-connected-devicesneverThese cookies are set via embedded youtube-videos.
yt-remote-device-idneverThese cookies are set via embedded youtube-videos.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
CookieDurationDescription
__gpi1 year 24 daysNo description
adImpCountpastNo description
C3UID5 yearsNo description available.
C3UID-9245 yearsNo description
fc5 months 27 daysNo description available.
pfpastNo description
pxs5 months 27 daysNo description available.
SAVE & ACCEPT
Powered by CookieYes Logo