Tag Info

New answers tagged

3

With respect to your question about using Vertica during the ETL, it's very rarely necessary (although not unknown) to use a different type of database for the ETL. I would not do that unless you perceive a specific need to do so. The only times I've ever heard of this being done due to interactions with legacy data sources. Although @Kermit works with ...


3

I'm going to assume that you already have the budget to implement some data warehouse solution. Just briefly talking about Vertica; it is a load and read optimized platform, and certainly not designed for OLTP. The piece on staging and processing data would need some more thought. Vertica isn't really designed to have data staged, cleansed, and moved into ...


-1

You should go with mongoDB. My recommendation is to create a sharded environment using as shard key the restaurant identifier - i guess most of your queries will include that.


1

I sat down with management and said, "alright, what's the goal here?" Once we talked about it, they decided to let me write it in Python and use Postgres, since we use Postgres internally. I was able to convince them of that because of the dynamic libraries and the fact that I can tune the instance to cache everything and keep it in memory. So...a highly ...


1

I can only say that you have my deepest sympathies. Doesn't the person/company who/which is getting you to write a tool under this mind-boggling constraint realise that you'll have to do far more work for a far lesser return than if you used (as you say) "Python, Perl...". Anyway, what you wrote rang a very old bell in my memory cells - I remembered having ...


0

Use the official sample databases from MySQL: http://dev.mysql.com/doc/index-other.html.


0

MySQL can handle millions of records just fine and is one of the most prevalent databases available, so you will find plenty of support and tools on the web for it. There is little performance difference between MySQL and other databases like PostgreSQL (another fine Database). I regularly use http://excel2mysql.net to automate the import of 1 million+ ...


0

Here are some additional thoughts, from somebody who has designed an invoicing subsystem: What is apply_tax1 and apply_tax2? Why is late_fee a decimal? Why is it stored on the invoice? How will you keep track of updating the late_fee? Allowance and charge instructions, including late fees, typically belong to an Order. You do not have the concept of an ...



Top 50 recent answers are included