Questions tagged [data-validation]
The data-validation tag has no usage guidance, but it has a tag wiki.
30
questions
0
votes
0
answers
60
views
Data validation for RDS PostgreSQL migration
I'm planning to replace a bunch of RDS PostgreSQL databases using this method defined by AWS.
The DMS task will run will be CDC-only. I came up with data validation requirements for the migration and ...
- 129
0
votes
0
answers
279
views
Validate Excel File data source in SSIS package
I need to load a number of Excel files using SSIS package into a SQL Server table. I am able to successfully loop through and load my Excel files into my table I do not have any issue doing that, BUT ...
0
votes
0
answers
67
views
Oracle Database schema validation
I am working on a database migration and
want to validate the destination schema against the source schema for Tables, Views, Indexes, Sequences, Constraints etc. I can do that by querying the dba_ ...
0
votes
1
answer
59
views
Best practices for tracking ingested data sources
I am in the process of creating an ingestion pipeline wherein there exists a step of periodically reading new .csv files and storing them into a postgres database. This step is functioning, however it ...
- 101
2
votes
2
answers
471
views
Post migration MySQL database validation
We are migrating from 5.5 enterprise mysql to 8.0 mysql enterprise edition. And we are migrating version by version like from 5.5 to 5.6 then 5.6 to 5.7 and lastly from 5.7 to 8.0 also os migration ...
- 21
0
votes
0
answers
798
views
"Document Failed Validation" what is wrong with my schema validation
I am trying to create a collection with JsonSchema (really its "BsonSchema") validation. This is a document that I want to insert (with bogus values). Note that Id is coming from the mongo ...
- 101
1
vote
1
answer
347
views
Validating SQL Server Change Tracking Synchronization
I have some tables that I need to synchronize from one SQL Server database to another. I'm using SQL Server's "Change Tracking" feature. My program uses Change Tracking to synchronize the ...
0
votes
1
answer
15k
views
Validation logic for Mobile Number Column in SQL Server
I am creating a validation script and need help with mobile number validation logic with below details. Mobile number must be:
10 digits in length.
Cannot begin with a 1 or a 0 (For example:...
1
vote
1
answer
396
views
Always Encrypted Data Validation [closed]
Just a question in how could i validate duplicate data's in my database if columns is set to be encrypted(deterministic) in db?
I've tried running the following code, but receive the error below.
...
- 29
1
vote
1
answer
9k
views
SQL Server - MERGE duplicate SOURCE rows validation is only evaluated on UPDATE and DELETE clauses
I want SQL Server to throw an error at me if my SOURCE table contains duplicates as per the ON clause in every case, including INSERT, but it only does for the UPDATE and DELETE cases. Why doesn't it?
...
- 711
1
vote
0
answers
28
views
Selecting Duplicates on All Fields
I have an MS Access (no laughing at the back) database I've used to import a bunch of IIS logs into.
Having looked at the Excel files I pulled these in from, I'm worried going by the dates that some ...
- 11
1
vote
0
answers
34
views
How to use validation rule within database with drop down menus.
Building a scheduling database using access 2013 for my company. I currently have it set up so that only employees that have a rating of 3 or more for the particular job show up when you use the drop ...
- 11
2
votes
2
answers
1k
views
Insert/update data into relational database tables only after administrator approval - how to approach it?
I'm building a relational database that holds 21 tables, which is connected to my website application through PHP.
The website has search functionality which allows users to search this database. ...
- 25
1
vote
3
answers
8k
views
Validating the GST Identification Number (GSTIN)
The following image describes the format of the GST Identification Number:
The first 2 digits denote the unique State Code in accordance with the Indian Census 2011. For instance, the State Code of ...
- 113
0
votes
0
answers
99
views
Configuring GeoServer SQL Views and Validation
For a little background i want to mention that I am using GeoEXT with Geoserver.
I am using the Geoext comboboxes to search point data by name. The application works properly for name having single ...
Shahid Nawaz Khan
19
votes
2
answers
28k
views
How do I store phone numbers in PostgreSQL?
Let's assume I want to store phone numbers in a database. I may accept phone numbers from outside of the United States. How would I go about storing these phone numbers?
- 63.1k
0
votes
1
answer
547
views
db.collection.validate() missing output and verify() returned EBUSY on first run
logs of the successful run
# grep conn103640 mongodb.log | head -10
2017-01-12T11:29:51.492+0000 I ACCESS [conn103640] Successfully authenticated as principal tz6z on admin
2017-01-12T11:31:20.954+...
- 2,498
3
votes
2
answers
6k
views
Loop through list of fields, check against lookup table
I have a list of fields:
FIELD_DOMAIN_ENG_VW
+-------------+------------+-------------+
| TABLE_NAME | FIELD_NAME | DOMAIN_NAME |
+-------------+------------+-------------+
| ENG.TABLE_1 | FIELD_1 ...
- 1,457
0
votes
1
answer
3k
views
vba Excel data Validation error 'Application-defined or object-defined error'
I've read loads of similar questions and answers, but keep getting error.
What I do is I export query via
DoCmd.TransferSpreadsheet acExport, 8, "blabla", outputFile, True
Then I'm attempting to ...
- 11
3
votes
1
answer
696
views
use cases for db.collection.validate() - checks the structures within a namespace for correctness by scanning the collection’s data and indexes
I found on MongoDB mailing list one use case for db.collection.validate():
The count() command is generally an estimate of the current document
count, based upon statistics provided by the ...
- 2,498
20
votes
2
answers
23k
views
How do I determine why a MongoDB document is failing validation?
How do I determine why a MongoDB document insert is failing validation? All I get back is a writeError that says "Document failed validation", which isn't very helpful.
(This happens often, and I'd ...
- 303
1
vote
1
answer
258
views
Easy way to have non-tech users modify database?
We're in the process of engineering a BI solution.
One problem we have is that sadly a lot of HR information (start date, department, department change date, work hours, etc etc) -- seems to me ...
- 1,683
3
votes
4
answers
4k
views
Validate three digits before decimal and after decimal point six digits
I have columns called longitude and latitude with nvarchar data type. The user can enter something like (23.23424432),(432423.343), which should not be allowed.
Can anyone help me to validate this in ...
- 31
5
votes
1
answer
16k
views
Best Practice for SQL Server data validation
I have CSV files that I would like to import into SQL Server 2014. Each record in the files has around 20 columns, each of them should be validated for data type compliance as well as some other ...
- 2,877
2
votes
1
answer
3k
views
How to validate data before loading it to DB
I have a situation where in I have million records in CSV file, what I need to do is to apply some business validation on certain columns of CSV and load data to DB only if particular record is valid.
...
- 21
1
vote
1
answer
1k
views
MySQL-load data infile- invalid data validation
Is it possible to validate the data and load it in a table using load data infile?
This is the query
load data local infile 'C:/Users/970685/Desktop/SFcheck.csv'
into table wow_macro....
- 11
3
votes
1
answer
3k
views
Table structure for validating data using category and subcategory fields
I am creating a simple budget application, and the primary table will be a transaction table that contains things like the amount of the transaction, date, account, the category and subcategory (the ...
- 133
1
vote
1
answer
151
views
Can I enforce one field being dependent on another?
I would like to know if it's possible to have two fields (in this case bits) in the same table where one is dependent on another. For example Check2 may only be true if Check1 is true.
Note: I'm ...
- 283
1
vote
1
answer
665
views
Compare table content from different PostgreSQL 9.3 DBs
The problem
How do I efficiently and idiomatically compare the content of two tables, each in a different DB?
I have 3 DBs (the classic dev, stg and prod). Each DB has a few tables which should be ...
- 11.7k
3
votes
1
answer
11k
views
How to check the consistency of tables in mysql
I have few questions regarding consistency in Mysql in two scenarios
1st scenario:
How can I verify a restored backup matches the original DB data on all the tables?
We have two hosts with the same ...
- 606