Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [data-validation]

The tag has no usage guidance, but it has a tag wiki.

Filter by
Sorted by
Tagged with
0 votes
0 answers
75 views

Data validation for RDS PostgreSQL migration

I'm planning to replace a bunch of RDS PostgreSQL databases using this method defined by AWS. The DMS task will run will be CDC-only. I came up with data validation requirements for the migration and ...
trouble_bucket's user avatar
0 votes
0 answers
295 views

Validate Excel File data source in SSIS package

I need to load a number of Excel files using SSIS package into a SQL Server table. I am able to successfully loop through and load my Excel files into my table I do not have any issue doing that, BUT ...
Alex ghulami's user avatar
0 votes
0 answers
71 views

Oracle Database schema validation

I am working on a database migration and want to validate the destination schema against the source schema for Tables, Views, Indexes, Sequences, Constraints etc. I can do that by querying the dba_ ...
JuniorDeveloper's user avatar
0 votes
1 answer
66 views

Best practices for tracking ingested data sources

I am in the process of creating an ingestion pipeline wherein there exists a step of periodically reading new .csv files and storing them into a postgres database. This step is functioning, however it ...
SIRCAVEC's user avatar
  • 101
2 votes
2 answers
497 views

Post migration MySQL database validation

We are migrating from 5.5 enterprise mysql to 8.0 mysql enterprise edition. And we are migrating version by version like from 5.5 to 5.6 then 5.6 to 5.7 and lastly from 5.7 to 8.0 also os migration ...
Sameer Bille's user avatar
0 votes
0 answers
806 views

"Document Failed Validation" what is wrong with my schema validation

I am trying to create a collection with JsonSchema (really its "BsonSchema") validation. This is a document that I want to insert (with bogus values). Note that Id is coming from the mongo ...
StingyJack's user avatar
1 vote
1 answer
356 views

Validating SQL Server Change Tracking Synchronization

I have some tables that I need to synchronize from one SQL Server database to another. I'm using SQL Server's "Change Tracking" feature. My program uses Change Tracking to synchronize the ...
Davide De Simone's user avatar
0 votes
1 answer
15k views

Validation logic for Mobile Number Column in SQL Server

I am creating a validation script and need help with mobile number validation logic with below details. Mobile number must be: 10 digits in length. Cannot begin with a 1 or a 0 (For example:...
deep kachhawa's user avatar
1 vote
1 answer
402 views

Always Encrypted Data Validation [closed]

Just a question in how could i validate duplicate data's in my database if columns is set to be encrypted(deterministic) in db? I've tried running the following code, but receive the error below. ...
Nathan's user avatar
  • 29
1 vote
1 answer
9k views

SQL Server - MERGE duplicate SOURCE rows validation is only evaluated on UPDATE and DELETE clauses

I want SQL Server to throw an error at me if my SOURCE table contains duplicates as per the ON clause in every case, including INSERT, but it only does for the UPDATE and DELETE cases. Why doesn't it? ...
Elaskanator's user avatar
1 vote
0 answers
28 views

Selecting Duplicates on All Fields

I have an MS Access (no laughing at the back) database I've used to import a bunch of IIS logs into. Having looked at the Excel files I pulled these in from, I'm worried going by the dates that some ...
user788561's user avatar
1 vote
0 answers
34 views

How to use validation rule within database with drop down menus.

Building a scheduling database using access 2013 for my company. I currently have it set up so that only employees that have a rating of 3 or more for the particular job show up when you use the drop ...
Daniel's user avatar
  • 11
2 votes
2 answers
1k views

Insert/update data into relational database tables only after administrator approval - how to approach it?

I'm building a relational database that holds 21 tables, which is connected to my website application through PHP. The website has search functionality which allows users to search this database. ...
Boris J.'s user avatar
1 vote
3 answers
8k views

Validating the GST Identification Number (GSTIN)

The following image describes the format of the GST Identification Number: The first 2 digits denote the unique State Code in accordance with the Indian Census 2011. For instance, the State Code of ...
Sunil Patil's user avatar
0 votes
0 answers
99 views

Configuring GeoServer SQL Views and Validation

For a little background i want to mention that I am using GeoEXT with Geoserver. I am using the Geoext comboboxes to search point data by name. The application works properly for name having single ...
user avatar
19 votes
2 answers
29k views

How do I store phone numbers in PostgreSQL?

Let's assume I want to store phone numbers in a database. I may accept phone numbers from outside of the United States. How would I go about storing these phone numbers?
Evan Carroll's user avatar
  • 63.5k
0 votes
1 answer
551 views

db.collection.validate() missing output and verify() returned EBUSY on first run

logs of the successful run # grep conn103640 mongodb.log | head -10 2017-01-12T11:29:51.492+0000 I ACCESS [conn103640] Successfully authenticated as principal tz6z on admin 2017-01-12T11:31:20.954+...
Sybil's user avatar
  • 2,508
3 votes
2 answers
6k views

Loop through list of fields, check against lookup table

I have a list of fields: FIELD_DOMAIN_ENG_VW +-------------+------------+-------------+ | TABLE_NAME | FIELD_NAME | DOMAIN_NAME | +-------------+------------+-------------+ | ENG.TABLE_1 | FIELD_1 ...
User1974's user avatar
  • 1,467
0 votes
1 answer
3k views

vba Excel data Validation error 'Application-defined or object-defined error'

I've read loads of similar questions and answers, but keep getting error. What I do is I export query via DoCmd.TransferSpreadsheet acExport, 8, "blabla", outputFile, True Then I'm attempting to ...
Choper's user avatar
  • 11
3 votes
1 answer
697 views

use cases for db.collection.validate() - checks the structures within a namespace for correctness by scanning the collection’s data and indexes

I found on MongoDB mailing list one use case for db.collection.validate(): The count() command is generally an estimate of the current document count, based upon statistics provided by the ...
Sybil's user avatar
  • 2,508
20 votes
2 answers
23k views

How do I determine why a MongoDB document is failing validation?

How do I determine why a MongoDB document insert is failing validation? All I get back is a writeError that says "Document failed validation", which isn't very helpful. (This happens often, and I'd ...
Jonathan Wheeler's user avatar
1 vote
1 answer
263 views

Easy way to have non-tech users modify database?

We're in the process of engineering a BI solution. One problem we have is that sadly a lot of HR information (start date, department, department change date, work hours, etc etc) -- seems to me ...
user45867's user avatar
  • 1,683
3 votes
4 answers
4k views

Validate three digits before decimal and after decimal point six digits

I have columns called longitude and latitude with nvarchar data type. The user can enter something like (23.23424432),(432423.343), which should not be allowed. Can anyone help me to validate this in ...
teja's user avatar
  • 31
5 votes
1 answer
16k views

Best Practice for SQL Server data validation

I have CSV files that I would like to import into SQL Server 2014. Each record in the files has around 20 columns, each of them should be validated for data type compliance as well as some other ...
nojetlag's user avatar
  • 2,887
2 votes
1 answer
3k views

How to validate data before loading it to DB

I have a situation where in I have million records in CSV file, what I need to do is to apply some business validation on certain columns of CSV and load data to DB only if particular record is valid. ...
Vipin's user avatar
  • 21
1 vote
1 answer
1k views

MySQL-load data infile- invalid data validation

Is it possible to validate the data and load it in a table using load data infile? This is the query load data local infile 'C:/Users/970685/Desktop/SFcheck.csv' into table wow_macro....
SHEENA's user avatar
  • 11
3 votes
1 answer
3k views

Table structure for validating data using category and subcategory fields

I am creating a simple budget application, and the primary table will be a transaction table that contains things like the amount of the transaction, date, account, the category and subcategory (the ...
Josh's user avatar
  • 133
1 vote
1 answer
155 views

Can I enforce one field being dependent on another?

I would like to know if it's possible to have two fields (in this case bits) in the same table where one is dependent on another. For example Check2 may only be true if Check1 is true. Note: I'm ...
Chiramisu's user avatar
  • 283
1 vote
1 answer
669 views

Compare table content from different PostgreSQL 9.3 DBs

The problem How do I efficiently and idiomatically compare the content of two tables, each in a different DB? I have 3 DBs (the classic dev, stg and prod). Each DB has a few tables which should be ...
Adam Matan's user avatar
  • 11.7k
3 votes
1 answer
11k views

How to check the consistency of tables in mysql

I have few questions regarding consistency in Mysql in two scenarios 1st scenario: How can I verify a restored backup matches the original DB data on all the tables? We have two hosts with the same ...
com's user avatar
  • 606