Quantcast
Channel: Active questions tagged change-data-capture - Database Administrators Stack Exchange
Browsing latest articles
Browse All 106 View Live

SQL Server CDC (Change Data Capture) Existing Data Seed

I have an SQL Server Database with 100's of tables with as many rows in each and I'm turning on CDC for some reporting. Since data was created/inserted BEFORE turning on CDC, the CDC tables are current...

View Article



Change Tracking across several Tables

I'm looking into providing DB level change tracking within my system. I need to be able to track changes at an entity level, rather than just individual tables.Right now, we have triggers on each of...

View Article

Automatically detect table name in MSSQL Server database using stored function

I'm working on implementing Change Data Tracking in a SQL Server database and I set up a single table to test changes. In the past, changes have been made manually, but I'd like to create a way to...

View Article

CDC error - Error converting data type varchar to uniqueidentifier

I have CDC and Replication configured on an Always On cluster.I had to patch the SQL Server on Node 1 so I failed over the instance to node 2 and started patching node1.After about an hour one of the...

View Article

CDC - I cannot disable that on the second instance

I have change data capture enabled for most of the tables in one of my databases. Database is hosted on SQL Server instance with version 2016.I have some testing to be done, so I wanted to restore...

View Article


postgres 11.3 checksum validation post migration

I am in the process of migrating our AWS RDS postgresql from one account to another with zero downtime. I am going with pg_dump/pg_restore + AWS CDC for ongoing replication.I am looking for a way to...

View Article

Image may be NSFW.
Clik here to view.

How can I force a system function to use an index in SQL Server?

Good morning team,I’m really struggling to improve the performance of this function: sys.fn_cdc_map_time_to_lsn. It is a system function which is used by CDC, you can read a full description of what it...

View Article

Oracle query taking a very long time to execute

I am trying to run a couple of reconciliation queries to identify missed deletes from our change data capture tool, but I need it to run relatively fast...My source and target tables are identical but...

View Article


DR - Missing binlogs in Maxwell

We have a standard db.r6g.2xlarge RDS MySQL instance running in production with 2 replicas. Maxwell CDC is setup to publish binlogs to a Kafka topic.From a RPO point of view: in the worst case (say RDS...

View Article


SQL Server 2019 sys.sp_cdc_cleanup_change_table procedure not working

Although CDC works and all transactions are logged, we cannot clear the respective CDC table using the builtin procedure sys.sp_cdc_cleanup_change_table which should remove all the transaction except...

View Article

CDC Error - NULL Source Schema and Source Table - Error msg on both enable...

Today I re-enabled CDC on the primary node of an availability group. When the jobs were created the cleanup job failed with the following error:Could not delete change table entries made obsolete by a...

View Article

Image may be NSFW.
Clik here to view.

Sql Server 2012 Change Data Capture weird behaviour

In my Sql Server 2012 I have the following table in a database CREATE TABLE [dbo].[HumanResource]( [ID] [int] IDENTITY(1,1) NOT NULL, [Name] [nvarchar](50) NOT NULL, [IsHired] [bit] NULL, [Address]...

View Article

Commit logs under cdc_raw folder getting corrupted

I am using cassandra 3.11.12 version. I have recently enabled cdc_raw in cassandra configuration and created new key space and table with WITH cdc=true; and after inserting values ran the alter...

View Article


Image may be NSFW.
Clik here to view.

Can I change the owner of the cdc schema?

I've enabled Change Data Capture (CDC) on a database using exec sys.sp_cdc_enable_dbThis creates a new cdc schema which is owned by the cdc userselect s.* , dp.namefrom sys.schemas as sjoin...

View Article

Correlating SQL Audit transaction_id to LSN

I have a relatively simple question that is "Google resistant".I have a SQL Database Audit spec that logs a transaction_id. I also have a Change Data Capture (CDC) spec that logs __$seqval (LSN). As a...

View Article


Using CDC on Read only Secondary Managed instance

We are planning to migrate our on-premises database to Azure Managed instance. Is it possible to use Read Only secondary of the managed instance for CDC.

View Article

What is the meaning of lsn_time_mapping.start_lsn

I have enable Change Data Capture on a table. I'm trying to understand cdc.lsn_time_mapping. Unfortunately the documentation is vague and missing a column from the results.What's the difference between...

View Article


CDC is not working after restoring the databse

I have just restored my database using the below script,USE [master]GORESTORE DATABASE [MyDB] FROM DISK = N'C:\Program Files\Microsoft SQL Server\MSSQL14.SQLSTANDARD\MSSQL\Backup\mydb.bak' WITH FILE =...

View Article

Cleanup job for CDC failed

The clean up job for CDC failed with this error:Msg 596, Level 21, State 1, Line 0Cannot continue the execution because the session is in the kill state.Msg 0, Level 20, State 0, Line 0A severe error...

View Article

How do you correlate SQL Database Audit spec's log column transaction_id with...

How do you correlate SQL Database Audit log column "transaction_id" with a LSN either from the trans log or a CDC capture table?I am trying to do this because cdc only captures the data changes, while...

View Article

Incremental CDC from Postgresql for select rows

I have a postgresql DB which has tables containing multi-tenant data. Example:Table CustomerCustIdCust NameFirstCustASecondCustBTable CustomerShoppingDetItem NameCustId.Buying...

View Article


On demand snapshot and CDC from Postgresql multitenant DB

I have a Postgresql multitenant DB where each table contains tenant level metadata. e.g. Table "connector" Column | Type | Collation | Nullable | Default...

View Article


SQL Server - CDC - Log-Scan Process failed to construct a replicated command...

CDC is enabled on the database and multiple tables are included for cdc. We had been receiving the below alert intermittently, monthly once which is causing the changes not written on the CT tables. We...

View Article

CDC cleanup doesn't work even when using sp_cdc_cleanup_change_table which...

I'm running the query below to find CDC tables with data beyond the configured retention depth:SELECT DB_ID() AS database_id, ct.capture_instance, object_id, source_object_id,...

View Article

How i can get changes in DB postgresql without triggers

I have database, and in this database ~10 users changes rows, how i can get this changes and user who changed, without triggers. I tried read WAL, and there no info about who what change.

View Article


Clarifications on Maintenance jobs & CDC on upgrade to ENTERPRISE EDITION

Raising these on behalf of our DBA team. We are looking at moving to ENTERPRISE SQL SERVER 2022 soon and would need help clarifying a few things:We are looking at a 3-NODE setup:(1) NODE-1: Primary(2)...

View Article

Image may be NSFW.
Clik here to view.

CLEANUP and CAPTURE jobs not being created when CDC is enabled in an AOAG setup

We are in the process of upgrading to ENTERPRISE SQL SERVER 2022. The DB is configured with AOAG. When we enable CDC at the database/table level, for some reason, the CLEANUP and CAPTURE jobs are not...

View Article

Modify CDC Schema In SQL Server

Can we add a column in CDC captured tables?Basically we are going to process CDC rows and we want to tracked which rows are already processed. So we are thinking about adding a bit field to the CDC...

View Article

Anyone using CDC and having performance issues extracting net_changes? We...

So 8 tables are being tracked with CDC "@support_net_changes=1". 7 of them are ok in regards to performance. As some of these tables are only 10-40 million rows and data doesn't change that...

View Article



SQL Server DB Log keeps growing / CDC enabled database

I've enabled change data capture on a SQL Server database.The database is in full recovery mode.The LOG backups of the database are being done hourly.The capture jobs was running without any issues -...

View Article
Browsing latest articles
Browse All 106 View Live




Latest Images