[GENERAL] explain analyze showed improved results without changes, why? - Mailing list pgsql-general

From Chris Richards
Subject [GENERAL] explain analyze showed improved results without changes, why?
Date
Msg-id CAOan6TkJ2gC4Jvi_7x5CjszLd=KChD6Y4kN9WG4jVB=iafqpdg@mail.gmail.com
Whole thread Raw
Responses Re: [GENERAL] explain analyze showed improved results withoutchanges, why?
List pgsql-general
Howdy. I was noticing a significant problem with a query on one of my tables. I tried recreating the problem and wasn't able to do so on a different install, and so a few days later I ran the same query on the problem table. Lo' and behold, there wasn't a problem anymore. I'm at a loss to why. The indices and two explains follow below. Thanks in advance for the help.

Cheers,
Chris

Indexes:
    "blocks_pkey" PRIMARY KEY, btree (cloudidx, blkid)
    "blocks_blkid_idx" btree (blkid)
    "blocks_cloudidx_idx" btree (cloudidx)
    "blocks_off_sz_idx" btree (off, sz)

mdb=> explain analyze SELECT * FROM blocks
 WHERE cloudidx=98038 AND off+sz >= 0 AND state='seeded'
 ORDER BY off LIMIT 1 FOR UPDATE;
                                                                      QUERY PLAN
-------------------------------------------------------------------------------------------------------------------------------------------------------
 Limit  (cost=0.43..587.83 rows=1 width=100) (actual time=4814.579..4814.579 rows=1 loops=1)
   ->  LockRows  (cost=0.43..1358633.99 rows=2313 width=100) (actual time=4814.577..4814.577 rows=1 loops=1)
         ->  Index Scan using blocks_off_sz_idx on blocks  (cost=0.43..1358610.86 rows=2313 width=100) (actual time=4813.498..4814.384 rows=2 loops=1)
               Filter: ((cloudidx = 98038) AND (state = 'seeded'::block_state) AND ((off + sz) >= 0))
               Rows Removed by Filter: 6935023
 Total runtime: 4814.619 ms
(6 rows)

mdb=> select count(*) from blocks;
  count
----------
 11052135
(1 row)

mdb=> select count (distinct (cloudidx)) from blocks;
 count
-------
  4549
(1 row)

And here's the second. Notice that even though there are more rows, it was much faster and the "rows removed by filter" were significantly reduced by several orders of magnitude.

mdb=> explain analyze SELECT * FROM blocks
 WHERE cloudidx=98038 AND off+sz >= 0 AND state='seeded'
 ORDER BY off LIMIT 1 FOR UPDATE;
                                                                   QUERY PLAN
-------------------------------------------------------------------------------------------------------------------------------------------------
 Limit  (cost=0.43..584.57 rows=1 width=100) (actual time=0.071..0.071 rows=1 loops=1)
   ->  LockRows  (cost=0.43..1390825.21 rows=2381 width=100) (actual time=0.070..0.070 rows=1 loops=1)
         ->  Index Scan using blocks_off_sz_idx on blocks  (cost=0.43..1390801.40 rows=2381 width=100) (actual time=0.055..0.055 rows=1 loops=1)
               Filter: ((cloudidx = 98038) AND (state = 'seeded'::block_state) AND ((off + sz) >= 0))
               Rows Removed by Filter: 26
 Total runtime: 0.114 ms
(6 rows)

mdb=> select count(*) from blocks;
  count
----------
 11328801
(1 row)

mdb=> select count (distinct (cloudidx)) from blocks;
 count
-------
  4613
(1 row)

pgsql-general by date:

Previous
From: nomad@null.net
Date:
Subject: Re: [GENERAL] Bug? Netmask of CIDR as TEXT has trailing masklen
Next
From: Tom Lane
Date:
Subject: Re: [GENERAL] Bug? Netmask of CIDR as TEXT has trailing masklen