SQL Server CDC (Change Data Capture) Existing Data Seed
I have an SQL Server Database with 100's of tables with as many rows in each and I'm turning on CDC for some reporting. Since data was created/inserted BEFORE turning on CDC, the CDC tables are current...
View ArticleChange Tracking across several Tables
I'm looking into providing DB level change tracking within my system. I need to be able to track changes at an entity level, rather than just individual tables.Right now, we have triggers on each of...
View ArticleAutomatically detect table name in MSSQL Server database using stored function
I'm working on implementing Change Data Tracking in a SQL Server database and I set up a single table to test changes. In the past, changes have been made manually, but I'd like to create a way to...
View ArticleCDC error - Error converting data type varchar to uniqueidentifier
I have CDC and Replication configured on an Always On cluster.I had to patch the SQL Server on Node 1 so I failed over the instance to node 2 and started patching node1.After about an hour one of the...
View ArticleCDC - I cannot disable that on the second instance
I have change data capture enabled for most of the tables in one of my databases. Database is hosted on SQL Server instance with version 2016.I have some testing to be done, so I wanted to restore...
View Articlepostgres 11.3 checksum validation post migration
I am in the process of migrating our AWS RDS postgresql from one account to another with zero downtime. I am going with pg_dump/pg_restore + AWS CDC for ongoing replication.I am looking for a way to...
View ArticleHow can I force a system function to use an index in SQL Server?
Good morning team,I’m really struggling to improve the performance of this function: sys.fn_cdc_map_time_to_lsn. It is a system function which is used by CDC, you can read a full description of what it...
View ArticleOracle query taking a very long time to execute
I am trying to run a couple of reconciliation queries to identify missed deletes from our change data capture tool, but I need it to run relatively fast...My source and target tables are identical but...
View ArticleDR - Missing binlogs in Maxwell
We have a standard db.r6g.2xlarge RDS MySQL instance running in production with 2 replicas. Maxwell CDC is setup to publish binlogs to a Kafka topic.From a RPO point of view: in the worst case (say RDS...
View ArticleSQL Server 2019 sys.sp_cdc_cleanup_change_table procedure not working
Although CDC works and all transactions are logged, we cannot clear the respective CDC table using the builtin procedure sys.sp_cdc_cleanup_change_table which should remove all the transaction except...
View ArticleCDC Error - NULL Source Schema and Source Table - Error msg on both enable...
Today I re-enabled CDC on the primary node of an availability group. When the jobs were created the cleanup job failed with the following error:Could not delete change table entries made obsolete by a...
View ArticleSql Server 2012 Change Data Capture weird behaviour
In my Sql Server 2012 I have the following table in a database CREATE TABLE [dbo].[HumanResource]( [ID] [int] IDENTITY(1,1) NOT NULL, [Name] [nvarchar](50) NOT NULL, [IsHired] [bit] NULL, [Address]...
View ArticleCommit logs under cdc_raw folder getting corrupted
I am using cassandra 3.11.12 version. I have recently enabled cdc_raw in cassandra configuration and created new key space and table with WITH cdc=true; and after inserting values ran the alter...
View ArticleCan I change the owner of the cdc schema?
I've enabled Change Data Capture (CDC) on a database using exec sys.sp_cdc_enable_dbThis creates a new cdc schema which is owned by the cdc userselect s.* , dp.namefrom sys.schemas as sjoin...
View ArticleCorrelating SQL Audit transaction_id to LSN
I have a relatively simple question that is "Google resistant".I have a SQL Database Audit spec that logs a transaction_id. I also have a Change Data Capture (CDC) spec that logs __$seqval (LSN). As a...
View ArticleUsing CDC on Read only Secondary Managed instance
We are planning to migrate our on-premises database to Azure Managed instance. Is it possible to use Read Only secondary of the managed instance for CDC.
View ArticleWhat is the meaning of lsn_time_mapping.start_lsn
I have enable Change Data Capture on a table. I'm trying to understand cdc.lsn_time_mapping. Unfortunately the documentation is vague and missing a column from the results.What's the difference between...
View ArticleCDC is not working after restoring the databse
I have just restored my database using the below script,USE [master]GORESTORE DATABASE [MyDB] FROM DISK = N'C:\Program Files\Microsoft SQL Server\MSSQL14.SQLSTANDARD\MSSQL\Backup\mydb.bak' WITH FILE =...
View ArticleCleanup job for CDC failed
The clean up job for CDC failed with this error:Msg 596, Level 21, State 1, Line 0Cannot continue the execution because the session is in the kill state.Msg 0, Level 20, State 0, Line 0A severe error...
View ArticleHow do you correlate SQL Database Audit spec's log column transaction_id with...
How do you correlate SQL Database Audit log column "transaction_id" with a LSN either from the trans log or a CDC capture table?I am trying to do this because cdc only captures the data changes, while...
View ArticleIncremental CDC from Postgresql for select rows
I have a postgresql DB which has tables containing multi-tenant data. Example:Table CustomerCustIdCust NameFirstCustASecondCustBTable CustomerShoppingDetItem NameCustId.Buying...
View ArticleOn demand snapshot and CDC from Postgresql multitenant DB
I have a Postgresql multitenant DB where each table contains tenant level metadata. e.g. Table "connector" Column | Type | Collation | Nullable | Default...
View ArticleSQL Server - CDC - Log-Scan Process failed to construct a replicated command...
CDC is enabled on the database and multiple tables are included for cdc. We had been receiving the below alert intermittently, monthly once which is causing the changes not written on the CT tables. We...
View ArticleCDC cleanup doesn't work even when using sp_cdc_cleanup_change_table which...
I'm running the query below to find CDC tables with data beyond the configured retention depth:SELECT DB_ID() AS database_id, ct.capture_instance, object_id, source_object_id,...
View ArticleHow i can get changes in DB postgresql without triggers
I have database, and in this database ~10 users changes rows, how i can get this changes and user who changed, without triggers. I tried read WAL, and there no info about who what change.
View ArticleClarifications on Maintenance jobs & CDC on upgrade to ENTERPRISE EDITION
Raising these on behalf of our DBA team. We are looking at moving to ENTERPRISE SQL SERVER 2022 soon and would need help clarifying a few things:We are looking at a 3-NODE setup:(1) NODE-1: Primary(2)...
View ArticleCLEANUP and CAPTURE jobs not being created when CDC is enabled in an AOAG setup
We are in the process of upgrading to ENTERPRISE SQL SERVER 2022. The DB is configured with AOAG. When we enable CDC at the database/table level, for some reason, the CLEANUP and CAPTURE jobs are not...
View ArticleModify CDC Schema In SQL Server
Can we add a column in CDC captured tables?Basically we are going to process CDC rows and we want to tracked which rows are already processed. So we are thinking about adding a bit field to the CDC...
View ArticleAnyone using CDC and having performance issues extracting net_changes? We...
So 8 tables are being tracked with CDC "@support_net_changes=1". 7 of them are ok in regards to performance. As some of these tables are only 10-40 million rows and data doesn't change that...
View ArticleSQL Server DB Log keeps growing / CDC enabled database
I've enabled change data capture on a SQL Server database.The database is in full recovery mode.The LOG backups of the database are being done hourly.The capture jobs was running without any issues -...
View Article
More Pages to Explore .....