May 28, 2014

The Efficient Analyst (part one): Stop moving your data around!


Many organizations collaborate by moving data and information between people, files or applications.  While movement may provide analysts with the illusion of adding value, data movement is not the same thing as data sharing. While the latter is a good thing to be nurtured, the former causes version control problems, wasted time, and analyst frustration.

In our original post on why data analysts are so inefficient, we covered the six core causes of data waste. In today's post we'll tackle the first cause: conveyance.  Below are five ways to reduce data movement and put the focus back on sharing.

1. Stop emailing (IMing, Skyping) files back and forth. Email and chat programs are some of the most popular ways to move data around. While we are all guilty of doing this every now and then, it creates huge access and version control problems for your team. Stop doing it. The most effective alternative is to utilize your company's sharing environment to store and update files. Don't have a sharing environment? Go to #4.

2. Eliminate "staging" files or sheets. A good general rule is: do not put data into a spreadsheet, database or file that does not add specific value. Many use staging files when restructuring or reformatting data before being used by someone or something else. Eliminating these types of files not only eliminates waste and confusion, but also ensures faster assembly of process documentation.

3. Be careful with "movement automation". This category can include FTP syncs, VBA macros or any other kind of automated process that pulls data from one location into another. FTP syncs often create timing bottlenecks (to be discussed in a future post) or create confusion among users. VBA macro code in Excel can cause chaos when there are structural changes in either the source or destination spreadsheets. In general, any kind of data automation must be handled with a high level of care and used only when the risk outweighs the amount of effort it takes to manually execute the task.

4. Create a sharing environment. There are many products for sharing data across organizations. Some upload files to share drives or use Sharepoint or Dropbox, while others will build custom SQL databases to store raw data. Some use Shooju. Whatever option you choose, ensuring that it is a complete solution is critical to creating any form of internal data harmony. Because of the confusion they can cause without full adoption, partial solutions can be worse than no solution at all.

5. Google it. Some organizations have no love lost for the cloud, while others are rapidly making the transition. Wherever your company is positioned, Google Drive can be an excellent solution to specific sharing problems. While seasoned data analysts may scoff at this idea, there are great ways to track changes and store raw data sets that streamline shared data flow.

A word about sharing across applications


The suggestions in this post are most effective when moving data between individuals using the same application - i.e. moving an Excel file to another Excel user. Sharing data across applications is much more difficult. In many organizations, analysts that use more advanced analytical tools like SAS often have to export results into Excel spreadsheets (creating a "staging problem") and email them (gasp!) to colleagues who are non-SAS users. Additionally, keeping this staging files updated can be a big pain.


Readers: what tips do you have to solve data sharing across applications? Leave them in the comments below.

93 comments :

  1. I am grateful for touching data breach topic. As the staff member of one of the best online data room providers I want to emphasize the problem of the private account invasion, and also I underline that it should be given more attention to that issue by the law makers.

    ReplyDelete
    Replies
    1. Big data is a term that describes the large volume of data – both structured and unstructured – that inundates a business on a day-to-day basis. IEEE Projects for CSE in Big Data But it’s not the amount of data that’s important. Final Year Project Centers in Chennai It’s what organizations do with the data that matters. Big data can be analyzed for insights that lead to better decisions and strategic business moves.

      Spring Framework has already made serious inroads as an integrated technology stack for building user-facing applications. Corporate TRaining Spring Framework the authors explore the idea of using Java in Big Data platforms.
      Specifically, Spring Framework provides various tasks are geared around preparing data for further analysis and visualization. Spring Training in Chennai

      Delete
  2. When the day dawns and you have to move your belongings from one place to another the first thing you have to do is ask yourself just how to get your stuff from your present location to your destination. Secondly, you have to find a good moving company. Movers Dallas

    ReplyDelete
  3. Overseeing of the huge information isn't less demanding then you think it takes a few methods and traps for the overseeing of huge type of unthinkable information, so in the event that you don't have the foggiest idea about these systems and trap then you ought to need to visit this website the original source Active Wizards for getting the best information researcher for you who will oversee you enormous information for you.

    ReplyDelete
  4. This blog is a punchy bit of composing, as it has a solid impact.
    Removals service

    ReplyDelete
  5. Pretty amazing work on the author's part and This blog is a five star work.
    man with van services

    ReplyDelete
  6. Imagine yesterday went to some online casino practicable online casino gambling sites and decided to ponastalgirovat. so many pleasant memories when you again see this slot machine mmm cool

    ReplyDelete
  7. Glad to be a part of your blog I have find some informative info here. Last month I Moved my home to another city and (Safe Relocation) helped me. They are the best, Highly recommended!!

    ReplyDelete
  8. I have read all the comments and suggestions posted by the visitors for this article are very fine,We will wait for your next article so only.Thanks! cheap moving companies denver

    ReplyDelete
  9. Within this webpage, you'll see the page, you need to understand this data. Moving companies near me

    ReplyDelete
  10. Extraordinary interest by female and transsexual customers and all the more as of late, because of society's mentalities, the quantity of male customers is expanding.https://www.mudanzasmaiorica.com/

    ReplyDelete
  11. In this time your only wish is to settle things as quickly as possible because right now you and your family are surrounded by a lot of mess.

    Removals Rugby

    ReplyDelete
  12. I found so many interesting stuff in your blog especially its discussion. From the tons of comments on your articles, I guess I am not the only one having all the enjoyment here! keep up the good work... Moving

    ReplyDelete
  13. As I would like to think I don't believe that Data Entry Projects themselves are tricks.input data entry

    ReplyDelete
  14. Very efficiently written information. It will be beneficial to anybody who utilizes it, including me. Keep up the good work. For sure i will check out more posts. This site seems to get a good amount of visitors. https://northamptonremovalspro.co.uk

    ReplyDelete
  15. If the employees are forced to use data that are disorganized, outdated and even misused, data entry outsource then this leads to unfortunate circumstances that even extend to the business partners, manufacturers and the customers.

    ReplyDelete
  16. Before selecting a mover, take a few minutes to think about your needs. Do you want to do most of the packing yourself, or would you prefer a full service mover who will handle all of the packing and unpacking for you? Moving services

    ReplyDelete
  17. Really a nice and informative post. Your explanation skill is really amazing. Thanks for this helpful article on moving data. Movers in Fort Worth

    ReplyDelete
  18. You should avoid hiring a moving company if any of the following situations arise Relocation services

    ReplyDelete
  19. On the surface, cardboard packaging may seem like a minor consideration for business operations - but in fact, the packaging process could be costing your company a lot of time and money if you don't have an effective strategy in place! quickboxespackaging.com

    ReplyDelete
  20. There are some ways to save much money on your visit to Budapest. One of these is instead of staying in expensive hotels, try renting a Immobilien in Budapest

    ReplyDelete
  21. Tasty Maza!
    Here At Tastymaza You Will Discover A Large Number Of Free Pakistani Recipes, Indian Recipes And Cooking Recordings From Popular Pakistani Recipes Cooking Shows. Likewise Specific Territorial, South Indian, North Indian Middle Eastern And Arabian Premium Food Plans Both In English And Urdu. Tastymaza.com Is The Brisk And Simple Approach To Look For Recipes, Cooking Recordings From Cooking Shows Of Your Decision And Moreover Included Mehndi Design And Style Changes.
    Tasty Maza

    ReplyDelete
  22. Lovely product thanks for sharing the information post to keep it up.
    Cigarette Boxes for sale
    Coffee Boxes for sale

    ReplyDelete
  23. This is the best post I have ever seen. Very clear and simple. Mid-portion Is quite interesting though. Keep doing this. I will visit your site again. Izaya Orihara Jacket

    ReplyDelete
  24. Amazing product thanks for sharing with us It is very informative.
    Hotel Boxes new york
    Invitation box company

    ReplyDelete
  25. This comment has been removed by the author.

    ReplyDelete
  26. thanks for sharing this article really helpful for me and i think for others as well, other hand if you need Software Boxes you can contact us

    ReplyDelete
  27. Our the purpose is to share the reviews about the latest Jackets,Coats and Vests also shre the related Movies,Gaming, Casual,Faux Leather and Leather materials available Ninja Jacket

    ReplyDelete
  28. Pretty good post. I have really enjoyed reading your blog. Maison Margiela Varsity Jacket

    ReplyDelete
  29. This comment has been removed by the author.

    ReplyDelete

  30. Excellent Blog! I would like to thank you for the efforts you have made in writing this post. Gained lots of knowledge.
    Data Analytics Course

    ReplyDelete
  31. Awesome article. I enjoyed reading your articles. this can be really a good scan for me. wanting forward to reading new articles. maintain the nice work!
    Data Science Courses in Bangalore

    ReplyDelete

  32. What an incredible message this is. Truly one of the best posts I have ever seen in my life. Wow, keep it up.
    AI Courses in Bangalore

    ReplyDelete

  33. I am sure it will help many people. Keep up the good work. It's very compelling and I enjoyed browsing the entire blog.
    Business Analytics Course in Bangalore

    ReplyDelete
  34. You have completed certain reliable points there. I did some research on the subject and found that almost everyone will agree with your blog.

    Data Science Training in Bangalore

    ReplyDelete
  35. I have voiced some of the posts on your website now, and I really like your blogging style. I added it to my list of favorite blogging sites and will be back soon ...

    Digital Marketing Training in Bangalore

    ReplyDelete
  36. I found Habit to be a transparent site, a social hub that is a conglomerate of buyers and sellers willing to offer digital advice online at a decent cost.

    Artificial Intelligence Training in Bangalore

    ReplyDelete
  37. The Extraordinary blog went amazed by the content that they have developed in a very descriptive manner. This type of content surely ensures the participants explore themselves. Hope you deliver the same near the future as well. Gratitude to the blogger for the efforts.

    Machine Learning Course in Bangalore

    ReplyDelete
  38. I feel very grateful that I read this. It is very helpful and very informative and I really learned a lot from it.
    Data Analytics Course

    ReplyDelete
  39. I am really enjoying reading your well written articles. I am looking forward to reading new articles. Keep up the good work.
    Data Science Courses in Bangalore

    ReplyDelete
  40. What an incredible message this is. Truly one of the best posts I have ever seen in my life. Wow, keep it up.
    AI Courses in Bangalore

    ReplyDelete

  41. I am sure it will help many people. Keep up the good work. It's very compelling and I enjoyed browsing the entire blog.
    Business Analytics Course in Bangalore

    ReplyDelete
  42. Incredible blog here! It's mind boggling posting with the checked and genuinely accommodating data. Bane Coat

    ReplyDelete
  43. I read blogs on a similar topic, but I never visited your blog. I added it to favorites and I’ll be your constant reader. Arthur Morgan Jacket

    ReplyDelete
  44. Good blog and absolutely exceptional. You can do a lot better, but I still say it's perfect. Keep doing your best.

    Machine Learning Training in Bangalore

    ReplyDelete

  45. Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.


    bulletintech
    jay cutler bodybuilder net worth
    ella rose mann
    staffing alternatives
    brad williams wife
    persona 5 fusion
    coryxkenshin dead
    Jana Kramer
    amber lancaster
    master root apk

    ReplyDelete
  46. Happy to chat on your blog, I feel like I can't wait to read more reliable posts and think we all want to thank many blog posts to share with us.

    Data Science in Bangalore

    ReplyDelete
  47. This blog is very informative. Packing can be a long hectic process but it can be made easier by following the tips that you have mentioned above. Thanks for sharing such important and useful information. Keep it up.
    visit mentioned website for printing services.
    custom gift packaging
    Packaging boxes wholesale
    Custom candy packaging
    cake boxes wholesale

    ReplyDelete
  48. Her blog has given us valuable information to work on. Every tip in your post is amazing. Thank you so much for sharing. Keep blogging.

    Data Science Training in Bangalore

    ReplyDelete
  49. We offer a wide range of Custom CBD Boxes to work with our clients. The crates are produced with the sturdy material went through most recent machines. Eco-accommodating methodology is made a piece of all the assembling.

    ReplyDelete
  50. Thank you for posting this information. I just want to let you know that I just visited your site and find it very interesting and informative. I look forward to reading most of your posts.

    Data Science Course in Patna

    ReplyDelete
  51. A good blog always contains new and exciting information, and reading it I feel like this blog really has all of these qualities that make it a blog.

    Data Science Course in Nagpur

    ReplyDelete
  52. You know your projects stand out from the crowd. There is something special about them. I think they're all really cool!

    Business Analytics Course in Durgapur

    ReplyDelete
  53. Excellent effort to make this blog more wonderful and informative. The information shared was very useful.
    Data Analytics Course in Chandigarh

    ReplyDelete
  54. Very nice job... Thanks for sharing this amazing and educative blog post!
    Data Science Course in Chandigarh

    ReplyDelete
  55. It is a great pleasure to read your message. It's full of information I'm looking for and love to post a comment that says "The content of your post is amazing". Excellent work.

    Business Analytics Course in Ernakulam

    ReplyDelete
  56. A good blog always contains new and exciting information, and reading it I feel like this blog really has all of these qualities that make it a blog.

    Data Science Training in Durgapur

    ReplyDelete
  57. Very useful message. This is my first time visiting here. I found a lot of interesting things on your blog, especially your discussion. It really is a great article. Keep on going.

    Data Analytics Course in Ernakulam

    ReplyDelete
  58. Thank you for your message. I've been thinking about writing a very similar article for the last few weeks, I'll probably keep it short and to the point and link to this article instead if that's interesting. Thank you.

    Business Analytics Course in Ernakulam

    ReplyDelete
  59. Really, this article is truly one of the best in article history. I am a collector of old "items" and sometimes read new items if I find them interesting. And this one that I found quite fascinating and should be part of my collection. Very good work!

    Data Scientist Training in Bangalore

    ReplyDelete
  60. It would also motivate almost everyone to save this webpage for their favorite helper to help get the look published.

    Data Science Training in Patna

    ReplyDelete
  61. It is late to find this act. At least one should be familiar with the fact that such events exist. I agree with your blog and will come back to inspect it further in the future, so keep your performance going.

    Best Data Analytics Courses in Bangalore

    ReplyDelete
  62. Good blog and absolutely exceptional. You can do a lot better, but I still say it's perfect. Keep doing your best.

    Data Science Training in Nagpur

    ReplyDelete
  63. I read your excellent post. It's a great job. I enjoyed reading your post for the first time. I want to thank you for this publication. Thank you...

    Data Analytics Course in Patna

    ReplyDelete
  64. wow ... what a great blog, this writer who wrote this article is really a great blogger, this article inspires me so much to be a better person.

    Business Analytics Course in Nagpur

    ReplyDelete
  65. Its content is brilliant in many ways. I think it is an attractive and revealing material. Thank you very much for caring about your content and your readers.

    Business Analytics Course in Patna

    ReplyDelete
  66. Really impressed! Everything is a very open and very clear clarification of the issues. It contains true facts. Your website is very valuable. Thanks for sharing.

    Best Data Analytics Courses in Bangalore

    ReplyDelete
  67. Good blog and absolutely exceptional. You can do a lot better, but I still say it's perfect. Keep doing your best.

    Data Analytics Course in Nagpur

    ReplyDelete
  68. It's a smart blog. I mean it seriously. You have so much knowledge on this subject and so much passion. He also knows how to get people to join him, obviously from the answers.

    Data Analytics Course in Nagpur

    ReplyDelete
  69. Its content is brilliant in many ways. I think it is an attractive and revealing material. Thank you very much for caring about your content and your readers.

    Data Science Course in Durgapur

    ReplyDelete
  70. This is just the information I find everywhere. Thank you for your blog, I just subscribed to your blog. It's a good blog.

    Best Data Analytics Courses in Bangalore

    ReplyDelete
  71. I don't have time to read your entire site right now, but I have bookmarked it and added your RSS feeds as well. I'll be back in a day or two. Thank you for this excellent site.

    Data Analytics Course in Ernakulam

    ReplyDelete
  72. Good blog and absolutely exceptional. You can do a lot better, but I still say it's perfect. Keep doing your best.

    Data Science Training in Durgapur

    ReplyDelete
  73. First of all, you have a great blog. I will be interested in more similar topics. I see you have some very useful topics, I will always check your blog thank you.

    Data Science Training Institutes in Bangalore

    ReplyDelete
  74. I have read your article, it is very informative and useful to me, I admire the valuable information you offer in your articles. Thanks for posting it ...

    Business Analytics Course in Ernakulam

    ReplyDelete
  75. Happy to chat on your blog, I feel like I can't wait to read more reliable posts and think we all want to thank many blog posts to share with us.

    Data Science in Bangalore

    ReplyDelete
  76. Wonderful illustrated information. Thank you. It will certainly be very useful for my future projects. I would love to see more articles on the same topic!

    Data Science Training in Bangalore

    ReplyDelete
  77. Really impressed! Information shared was very helpful Your website is very valuable. Thanks for sharing.
    Business Analytics Course in Bangalore

    ReplyDelete
  78. This is an excellent article. I like this topic. This site has many advantages. I have found a lot of interesting things on this site. It helps me in so many ways. Thanks for posting this again.

    Data Analytics Course in Durgapur

    ReplyDelete
  79. 1xbet | 1xbet | Bet with a Bonus - RMC | Riders Casino
    1XBet allows you to bet on 1xbet korean any gri-go.com favourite poormansguidetocasinogambling.com horse races or any other sporting event. ✓ Get up to £300 + 200 Free Spins No Deposit casinosites.one

    ReplyDelete
  80. I always search online for articles that can help me. Obviously, there is a lot to know about this. I think you made a few good points about the features as well. Keep up the good work!

    Data Scientist Course in Ernakulam

    ReplyDelete
  81. Good blog and absolutely exceptional. You can do a lot better, but I still say it's perfect. Keep doing your best.

    Data Scientist Training in Bangalore

    ReplyDelete
  82. Its content is brilliant in many ways. I think it is an attractive and revealing material. Thank you very much for caring about your content and your readers.

    Business Analytics Course in Ernakulam

    ReplyDelete
  83. You know your projects stand out from the crowd. There is something special about them. I think they're all really cool!

    Business Analytics Course in Durgapur

    ReplyDelete
  84. Register for the Data Scientist courses in Bangalore and learn to build your Data Science and Machine learning workflows. Build a portfolio of work to have on your resume with live projects which are supported by an industry-relevant curriculum. Get Access to our learning management system (LMS) that provides you with all the material and assignments that will help you master all the concepts for you to solve any problem related to deciphering the hidden meaning in data.

    Data Science Training and Placement in Bangalore

    ReplyDelete
  85. Once you have chosen the correct mattress, you will now want to protect your investment. custom truck mattress

    ReplyDelete