Category: Data Warehouse Misc

Data Warehouse Misc. By Sayed

Oct 01

Resources on Software/Web/Mobile/Database Development

On Data Integrity and Persistence: https://code.tutsplus.com/tutorials/evolving-toward-a-persistence-layer–net-27138 https://www.fsl.cs.sunysb.edu/docs/integrity-storagess05/integrity.html http://www.artima.com/weblogs/viewpost.jsp?thread=269155 http://programmers.stackexchange.com/questions/327880/should-data-access-layer-mirror-my-database-configuration/327896 http://www.ambysoft.com/essays/persistenceLayer.html http://stackoverflow.com/questions/16016023/what-is-the-use-of-persistence-layer-in-any-application http://stackoverflow.com/questions/7474267/mvc3-and-entity-framework/7474357#7474357 https://wiki.haskell.org/Web/Databases_and_Persistence   On Investing: https://www.franklintempleton.ca/en-ca/public/campaigns/templeton-global-balanced-fund.page?utm_campaign=ca-tgbal-16&utm_source=bing&utm_medium=cpc&utm_term=canada%20best%20one%20fund%20etf&utm_content=10445411359   Misc: Code Change, Documentation, Freelancing https://www.devart.com/codecompare/download.html http://www.mkdocs.org https://chocolatey.org/install https://blog.zintro.com/2014/11/20/50-project-management-tools-freelance-consultants/   DevOps https://confluence.atlassian.com/doc/develop-technical-documentation-in-confluence-226166494.html https://aws.amazon.com/getting-started/tutorials/launch-a-wordpress-website/ https://aws.amazon.com/getting-started/tutorials/ https://aws.amazon.com/directconnect/ Estimating Costs for WordPress at Amazon AWS Which is less expensive: Amazon or self-hosted? http://programmers.stackexchange.com/questions/104096/which-platform-to-choose-java-or-net https://aws.amazon.com/documentation/vpc/   Misc Frontend http://stackoverflow.com/questions/31349765/react-js-and-php-together https://github.com/jnicol/tweet-php   …

Continue reading

Jul 06

Steps in Data Warehouse Design and Implementation

  Most BI projects usually fail. It is not due to the errors in the construction steps but due to the inappropriate design steps and methodologies. Waterfall method is not appropriate for BI. A method like developmental spiral may be more appropriate. Ref: [W. A. Giovinazzo ] Steps in developmental spiral: Definition, Analysis, Design, Development, …

Continue reading

Jul 05

Kimball and Inmon methodologies for Data Warehouse Development

http://www.computerweekly.com/tip/Inmon-vs-Kimball-Which-approach-is-suitable-for-your-data-warehouse

Jul 05

What is Data Warehousing?

A Data Warehouse is a storage of an organization’s historical data. Usually, data warehouse is built to provide a decision support system to the management. Data warehouse can be mined (using data mining) and queried to collect overall and summarized business information that significantly helps in decision making. It can provide trends over many years. …

Continue reading

Jul 04

Random Information on BI

Real internet money/business lies in B2B not in B2C. Decision Support System (DSS): Full spectrum of systems that allow/help management to take decisions, such as, reporting, OLAP, data mining. Java provides support for web enabled DSS JDM is Java’s Data mining/BI API. BI Applications: Balanced Score-card, Activity Based Costing. Data warehouse elements Operational Environment: Maintains …

Continue reading

Apr 26

On Data Management from Enterprise Data Analytics to Data-Based Decision Making

On Data Management from Enterprise Data Analytics to Data-Based Decision Making Establish data quality standards and train others in this regard Five steps to an improved data quality assurance plan Data Quality Standards Handbook on Data Quality Assessment Methods and Tools Five Fundamental Data Quality Practices data management/analysis software tools Top 27 Free Data Analysis …

Continue reading

Apr 17

Some Resources related to: Foundations of Enterprise Data Analytics, Part – 1

Probability and statistics refresher http://web.stanford.edu/class/msande223/handouts/psrev Data life cycle 7 Phases of A Data Life Cycle: http://www.information-management.com/news/data-management/Data-Life-Cycle-Defined-10027232-1.html What is data lifecycle management? : https://www-01.ibm.com/software/data/lifecycle-management/ Tools of Big Data Must Read: All the best big data tools and how to use them: https://www.import.io/post/all-the-best-big-data-tools-and-how-to-use-them/ Security and Privacy of Data IBM Data security and protection Platform: http://www-03.ibm.com/software/products/en/category/data-security It’s Not Security that Should Worry You. …

Continue reading

Sep 05

Some Data Analysis Tools

Just some Links: Data Collection and Analysis Tools http://asq.org/learn-about-quality/data-collection-analysis-tools/overview/overview.html   Big Data Analytics: Time For New Tools http://www.informationweek.com/big-data/big-data-analytics/big-data-analytics-time-for-new-tools/a/d-id/1318106   Data analysis tools target non-experts Tools simplify the application of advanced analytics and the interpretation of results http://radar.oreilly.com/2013/08/data-analysis-tools-target-non-experts.html   Guide to big data analytics tools, trends and best practices http://searchbusinessanalytics.techtarget.com/essentialguide/Guide-to-big-data-analytics-tools-trends-and-best-practices   Data Analysis Software and Tools …

Continue reading

Apr 03

Big Data Solutions

Traditional Approach of Data Analysis: Data is stored in RDBMS in one or couple of computers. And software are written for analysis. However, if the data is too big this approach is not sufficient. Also, all data may not fit/well-suited for RDBMS.   Google’s Approach: Google invented MAP Reduce to address big data challenge. Tasks …

Continue reading

Mar 21

Fact Table Design for a Data Warehouse

Fact Table Design for a Data Warehouse

Mar 07

Data Warehouse – Dimension Design

Data Warehouse – Dimension Design

Mar 01

Logical Design for Data Warehouse

Logical Design for Data Warehouse

Feb 24

Logical Design for Data Warehouse

Logical Design for Data Warehouse    

Feb 24

Data Warehouse design, key terms, key keywords

Data warehouse design, key terms, key keywords

Feb 14

With Examples: Steps that You Can Follow to Build a Data WareHouse

With Examples: Steps that You Can Follow to Build a Data WareHouse. You can jump directly into point 5 that actually is about real world complete examples with Steps. 1.  If you do not know what a data ware house is, please check the definition at: http://salearningschool.com/displayArticle.php?table=Articles&articleID=693 http://www.1keydata.com/datawarehousing/data-warehouse-definition.html Simply:  “a copy of transaction data specifically structured …

Continue reading

Dec 14

Part-2: Data Warehouse, Business Intelligence Learning Resources

Topics Include – Financial & process dashboards – ETL solutions using SSIS – Develop reports using SSRS – OLAP solutions using SSAS -Cube design – Programming Languages: T-SQL, MDX -Modeling Tools: Embarcadero ER Studio, CA Erwin, Visio -Development Tools: Visual Studio, SSDT, PerformancePoint Dashboard Designer. Related to Financial & process dashboards  Building Real-World Microsoft BI …

Continue reading

Dec 14

[Part-1] Data Warehouse Development Topics, and Links to Resources to Learn From

Data Warehouse Development Topics, and Links to Resources to Learn From   Introduction to Star and Snowflake Schemas http://www.tutorialspoint.com/dwh/dwh_schemas.htm   Designing Dimensions http://en.wikipedia.org/wiki/Dimensional_modeling   Data Warehouse Performance Management Techniques https://www.indiana.edu/~dbateam/resources/tips/dwperf.pdf   Loading and Auditing Loads Some theory: http://ceur-ws.org/Vol-19/paper14.pdf Extract, Transform, and Load for Data Warehouse: http://en.wikipedia.org/wiki/Extract,_transform,_load Loading Data into the Data Warehouse Database http://technet.microsoft.com/en-us/library/aa906013%28v=sql.80%29.aspx Audit for Real-Time …

Continue reading

Jul 01

ETL Tools

Ab Initio https://en.wikipedia.org/wiki/Ab_Initio_Software http://www.abinitio.com/   Informatica http://www.abinitio.com/ Why informatica etl is successful in data integration space ? Why informatica etl is successful in data integration space ?   IBM DataStage http://www-03.ibm.com/software/products/en/ibminfodata/   Data Integration Vendors: Comparison: http://www.adeptia.com/products/etl_vendor_comparison.html   Open source ETL Tools : Talend Integration Suite Pentaho Kettle Enterprise CloverETL http://www.etltools.net/free-etl-tools.html For Open Source ETL …

Continue reading

Jun 30

Requirements for Trading Applications, and Oracle Extreme Java Trading Platform

“Given the development and challenges of the electronic trading landscape, one can derive a shortlist of requirements for the technology platforms that will address those challenges: • High performance, high throughput, and low latency. • Deterministic and consistent performance in terms of latency. • High availability and resilience. • Fast to deploy, easy to maintain …

Continue reading

Feb 06

University Courses or Programs on Data Warehousing

http://www2.gre.ac.uk/study/courses/pg/com/dmdm http://oregonstate.edu/is/training/admin-systems-training/sis-training/dw https://www.villanovau.com/lp/business-intelligence/career/cert-mst_gainknowledge_t04_1110/?mcguid=7efad90f-381a-4f60-8908-20aaf505e364&mcid=24098&WT.srch=1&mkwid=sxXUgffxJ_dc&pcrid=27800095324&pmt=b&pkw=data%20warehouse%20certification&gclid=CKKGxaTCtrwCFe1cMgodK0cAGA https://wiki.engr.illinois.edu/display/cs412/2.+Course+Syllabus+and+Schedule

Feb 03

Related Resources: Data Architect and Data Architecture

Want to get a real-world perspective on what a Data Architect does? Check some job descriptions and find out http://www.indeed.com/q-Data-Architect-jobs.html — Check how Data Architecture is defined in Wikipedia http://en.wikipedia.org/wiki/Data_architecture — You can also check the resources provided on Implementing Data Warehouse at: http://salearningschool.com/displayArticle.php?table=Articles&articleID=775 How to implement BI/Warehouse Crime Detection using BI Credit Card fraud …

Continue reading

Nov 08

Hadoop Random Notes

Some Random Notes on Hadoop… Why Hadoop? …randomly came across again….so, Just some random stuff. I may try to relate my exposure to it (or something), even that remotely relates to Hadoop What is Hadoop? Apache Hadoop is an open-source software framework for storage and large scale processing of data-sets on clusters of commodity hardware. …

Continue reading

Skip to toolbar