Skip to main content

Table and Index Growth Ratio in PostgreSQL

Hi All,

Further to DBGrowth ratio, we have implemented the table and indexes growth ration and growth calculation percentages.

Step 1:- Create the following structure

CREATE TABLE ostats.tblgr(timestmp timestamp,tablename text,indexname text,table_size bigint,index_size bigint,total_table_size bigint,n_rows bigint,table_growth varchar(100),table_growth_percent real,index_growth varchar(100),index_growth_percent real);

Step 2:- Create the following Trigger Source

CREATE OR REPLACE FUNCTION ostats.FEED_TAB_GROWTH()
RETURNS TRIGGER
LANGUAGE PLPGSQL
AS $FUNCTION$
DECLARE
CHECK_TAB_PRESENCE INT;
PREV_TAB_SIZE BIGINT;
PREV_IND_SIZE BIGINT;
BEGIN
SELECT COUNT(*) INTO CHECK_tab_PRESENCE FROM ostats.tblgr WHERE LOWER(tablename)=NEW.tablename;
IF(CHECK_TAB_PRESENCE=0) THEN
RETURN NEW;
ELSE
SELECT table_size INTO PREV_tab_SIZE FROM ostats.tblgr WHERE(CTID,tablename) IN (SELECT MAX(CTID),tablename FROM ostats.tblgr GROUP BY tablename HAVING tablename=NEW.tablename);
SELECT index_size INTO PREV_IND_SIZE FROM ostats.tblgr WHERE(CTID,indexname) IN (SELECT MAX(CTID),indexname FROM ostats.tblgr GROUP BY indexname HAVING indexname=NEW.indexname);
IF(PREV_TAB_SIZE!=NEW.table_size) THEN
SELECT PG_SIZE_PRETTY(NEW.table_size::BIGINT-PREV_tab_SIZE) INTO NEW.table_growth;
SELECT ((NEW.table_size::REAL-1 -PREV_tab_SIZE::REAL)/(PREV_tab_SIZE+1)::REAL * 100) INTO NEW.table_growth_percent;
IF(PREV_IND_SIZE!=NEW.index_size and new.indexname is not null) THEN
SELECT PG_SIZE_PRETTY(NEW.index_size::BIGINT-PREV_ind_SIZE) INTO NEW.index_growth;
SELECT ((NEW.index_size::REAL-1 -PREV_ind_SIZE::REAL)/(PREV_ind_SIZE+1)::REAL * 100) INTO NEW.index_growth_percent;
END IF;
RETURN NEW;
end if;
END IF;
RETURN NULL;
END;
$FUNCTION$;

Step 3: Create the following trigger definition for the above source.

CREATE TRIGGER FEED_TAB_GROWTH_TRIG BEFORE INSERT ON ostats.tblgr FOR EACH ROW EXECUTE PROCEDURE ostats.FEED_TAB_GROWTH();

Step 4: Put the following Insert in the cronjob for getting the table and indexes growth.

insert into ostats.tblgr(timestmp,tablename,indexname,table_size,index_size,total_table_size,n_rows)
select now() timestmp,a.tablename,b.indexname,
pg_relation_size(a.schemaname||'.'||a.tablename::text) table_size,
pg_relation_size(b.schemaname||'.'||b.indexname::text) index_size,
pg_total_relation_size(a.schemaname||'.'||a.tablename::text) table_total_size,
d.reltuples::bigint reltuples
from
pg_tables a left outer join pg_indexes b on a.tablename=b.tablename inner join pg_class d on a.tablename=d.relname where a.schemaname !~ '^information_schema|^pg_catalog|^pg_toast|^pg_temp';

--Dinesh

Comments

Popular posts from this blog

Pgpool Configuration & Failback

I would like to share the pgpool configuration, and it's failback mechanism in this post.

Hope it will be helpful to you in creating pgpool and it's failback setup.

Pgpool Installation & Configuration

1. Download the pgpool from below link(Latest version is 3.2.1).
    http://www.pgpool.net/mediawiki/index.php/Downloads


2. Untart the pgpool-II-3.2.1.tar.gz and goto pgpool-II-3.2.1 directory.

3. Install the pgpool by executing the below commands:

./configure ­­prefix=/opt/PostgreSQL92/ ­­--with­-pgsql­-includedir=/opt/PostgreSQL92/include/ --with­-pgsql­-libdir=/opt/PostgreSQL92/lib/ make make install 4. You can see the pgpool files in /opt/PostgreSQL92/bin location.
/opt/PostgreSQL92/bin $ ls clusterdb   droplang  pcp_attach_node  pcp_proc_count pcp_systemdb_info  pg_controldata  pgpool pg_test_fsync pltcl_loadmod  reindexdb createdb    dropuser  pcp_detach_node  pcp_proc_info createlang  ecpg      pcp_node_count   pcp_promote_node oid2name  pcp_pool_status  pcp_stop_pgpool  …

pgBucket v1.0 is ready

pgBucket v1.0 pgBucket v1.0 (concurrent job scheduler for PostgreSQL) is released. This version is more stable and fixed the issues which was observed in the previous beta releases.
Highlights of this tool are Schedule OS/DB level jobsCron style syntax {Schedule up to seconds}On fly job modificationsInstant daemon status by retrieving live job queue, job hashEnough cli options to deal with all the configured/scheduled job Here is the URL for the pgBucket build/usage instructions. https://bitbucket.org/dineshopenscg/pgbucket
I hope this tool will be helpful for the PostgreSQL users to get things done in the scheduled time. Note: This tool requires c++11{gcc version >= 4.9.3} to compile.
--Dinesh

pgBucket - A new concurrent job scheduler

Hi All,

I'm so excited to announce about my first contribution tool for postgresql. I have been working with PostgreSQL from 2011 and I'm really impressed with such a nice database.

I started few projects in last 2 years like pgHawk[A beautiful report generator for Openwatch] , pgOwlt [CUI monitoring. It is still under development, incase you are interested to see what it is, attaching the image here for you ],


pgBucket [Which I'm gonna talk about] and learned a lot and lot about PostgreSQL/Linux internals.

Using pgBucket we can schedule jobs easily and we can also maintain them using it's CLI options. We can update/insert/delete jobs at online. And here is its architecture which gives you a basic idea about how it works.


Yeah, I know there are other good job schedulers available for PostgreSQL. I haven't tested them and not comparing them with this, as I implemented it in my way.
Features are: OS/DB jobsCron style sytaxOnline job modificationsRequired cli options