May 28, 2014

The Efficient Analyst (part one): Stop moving your data around!


Many organizations collaborate by moving data and information between people, files or applications.  While movement may provide analysts with the illusion of adding value, data movement is not the same thing as data sharing. While the latter is a good thing to be nurtured, the former causes version control problems, wasted time, and analyst frustration.

In our original post on why data analysts are so inefficient, we covered the six core causes of data waste. In today's post we'll tackle the first cause: conveyance.  Below are five ways to reduce data movement and put the focus back on sharing.

1. Stop emailing (IMing, Skyping) files back and forth. Email and chat programs are some of the most popular ways to move data around. While we are all guilty of doing this every now and then, it creates huge access and version control problems for your team. Stop doing it. The most effective alternative is to utilize your company's sharing environment to store and update files. Don't have a sharing environment? Go to #4.

2. Eliminate "staging" files or sheets. A good general rule is: do not put data into a spreadsheet, database or file that does not add specific value. Many use staging files when restructuring or reformatting data before being used by someone or something else. Eliminating these types of files not only eliminates waste and confusion, but also ensures faster assembly of process documentation.

3. Be careful with "movement automation". This category can include FTP syncs, VBA macros or any other kind of automated process that pulls data from one location into another. FTP syncs often create timing bottlenecks (to be discussed in a future post) or create confusion among users. VBA macro code in Excel can cause chaos when there are structural changes in either the source or destination spreadsheets. In general, any kind of data automation must be handled with a high level of care and used only when the risk outweighs the amount of effort it takes to manually execute the task.

4. Create a sharing environment. There are many products for sharing data across organizations. Some upload files to share drives or use Sharepoint or Dropbox, while others will build custom SQL databases to store raw data. Some use Shooju. Whatever option you choose, ensuring that it is a complete solution is critical to creating any form of internal data harmony. Because of the confusion they can cause without full adoption, partial solutions can be worse than no solution at all.

5. Google it. Some organizations have no love lost for the cloud, while others are rapidly making the transition. Wherever your company is positioned, Google Drive can be an excellent solution to specific sharing problems. While seasoned data analysts may scoff at this idea, there are great ways to track changes and store raw data sets that streamline shared data flow.

A word about sharing across applications


The suggestions in this post are most effective when moving data between individuals using the same application - i.e. moving an Excel file to another Excel user. Sharing data across applications is much more difficult. In many organizations, analysts that use more advanced analytical tools like SAS often have to export results into Excel spreadsheets (creating a "staging problem") and email them (gasp!) to colleagues who are non-SAS users. Additionally, keeping this staging files updated can be a big pain.


Readers: what tips do you have to solve data sharing across applications? Leave them in the comments below.

74 comments :

  1. I am grateful for touching data breach topic. As the staff member of one of the best online data room providers I want to emphasize the problem of the private account invasion, and also I underline that it should be given more attention to that issue by the law makers.

    ReplyDelete
    Replies
    1. Big data is a term that describes the large volume of data – both structured and unstructured – that inundates a business on a day-to-day basis. IEEE Projects for CSE in Big Data But it’s not the amount of data that’s important. Final Year Project Centers in Chennai It’s what organizations do with the data that matters. Big data can be analyzed for insights that lead to better decisions and strategic business moves.

      Spring Framework has already made serious inroads as an integrated technology stack for building user-facing applications. Corporate TRaining Spring Framework the authors explore the idea of using Java in Big Data platforms.
      Specifically, Spring Framework provides various tasks are geared around preparing data for further analysis and visualization. Spring Training in Chennai

      Delete
  2. When the day dawns and you have to move your belongings from one place to another the first thing you have to do is ask yourself just how to get your stuff from your present location to your destination. Secondly, you have to find a good moving company. Movers Dallas

    ReplyDelete
  3. Overseeing of the huge information isn't less demanding then you think it takes a few methods and traps for the overseeing of huge type of unthinkable information, so in the event that you don't have the foggiest idea about these systems and trap then you ought to need to visit this website the original source Active Wizards for getting the best information researcher for you who will oversee you enormous information for you.

    ReplyDelete
  4. This blog is a punchy bit of composing, as it has a solid impact.
    Removals service

    ReplyDelete
  5. Pretty amazing work on the author's part and This blog is a five star work.
    man with van services

    ReplyDelete
  6. Imagine yesterday went to some online casino practicable online casino gambling sites and decided to ponastalgirovat. so many pleasant memories when you again see this slot machine mmm cool

    ReplyDelete
  7. Glad to be a part of your blog I have find some informative info here. Last month I Moved my home to another city and (Safe Relocation) helped me. They are the best, Highly recommended!!

    ReplyDelete
  8. I have read all the comments and suggestions posted by the visitors for this article are very fine,We will wait for your next article so only.Thanks! cheap moving companies denver

    ReplyDelete
  9. Within this webpage, you'll see the page, you need to understand this data. Moving companies near me

    ReplyDelete
  10. Extraordinary interest by female and transsexual customers and all the more as of late, because of society's mentalities, the quantity of male customers is expanding.https://www.mudanzasmaiorica.com/

    ReplyDelete
  11. In this time your only wish is to settle things as quickly as possible because right now you and your family are surrounded by a lot of mess.

    Removals Rugby

    ReplyDelete
  12. I found so many interesting stuff in your blog especially its discussion. From the tons of comments on your articles, I guess I am not the only one having all the enjoyment here! keep up the good work... Moving

    ReplyDelete
  13. As I would like to think I don't believe that Data Entry Projects themselves are tricks.input data entry

    ReplyDelete
  14. Very efficiently written information. It will be beneficial to anybody who utilizes it, including me. Keep up the good work. For sure i will check out more posts. This site seems to get a good amount of visitors. https://northamptonremovalspro.co.uk

    ReplyDelete
  15. If the employees are forced to use data that are disorganized, outdated and even misused, data entry outsource then this leads to unfortunate circumstances that even extend to the business partners, manufacturers and the customers.

    ReplyDelete
  16. Before selecting a mover, take a few minutes to think about your needs. Do you want to do most of the packing yourself, or would you prefer a full service mover who will handle all of the packing and unpacking for you? Moving services

    ReplyDelete
  17. Really a nice and informative post. Your explanation skill is really amazing. Thanks for this helpful article on moving data. Movers in Fort Worth

    ReplyDelete
  18. You should avoid hiring a moving company if any of the following situations arise Relocation services

    ReplyDelete
  19. On the surface, cardboard packaging may seem like a minor consideration for business operations - but in fact, the packaging process could be costing your company a lot of time and money if you don't have an effective strategy in place! quickboxespackaging.com

    ReplyDelete
  20. There are some ways to save much money on your visit to Budapest. One of these is instead of staying in expensive hotels, try renting a Immobilien in Budapest

    ReplyDelete
  21. Lovely product thanks for sharing the information post to keep it up.
    Cigarette Boxes for sale
    Coffee Boxes for sale

    ReplyDelete
  22. Amazing product thanks for sharing with us It is very informative.
    Hotel Boxes new york
    Invitation box company

    ReplyDelete
  23. This comment has been removed by the author.

    ReplyDelete
  24. thanks for sharing this article really helpful for me and i think for others as well, other hand if you need Software Boxes you can contact us

    ReplyDelete
  25. This comment has been removed by the author.

    ReplyDelete

  26. Excellent Blog! I would like to thank you for the efforts you have made in writing this post. Gained lots of knowledge.
    Data Analytics Course

    ReplyDelete

  27. What an incredible message this is. Truly one of the best posts I have ever seen in my life. Wow, keep it up.
    AI Courses in Bangalore

    ReplyDelete

  28. I am sure it will help many people. Keep up the good work. It's very compelling and I enjoyed browsing the entire blog.
    Business Analytics Course in Bangalore

    ReplyDelete
  29. You have completed certain reliable points there. I did some research on the subject and found that almost everyone will agree with your blog.

    Data Science Training in Bangalore

    ReplyDelete
  30. I have voiced some of the posts on your website now, and I really like your blogging style. I added it to my list of favorite blogging sites and will be back soon ...

    Digital Marketing Training in Bangalore

    ReplyDelete
  31. The Extraordinary blog went amazed by the content that they have developed in a very descriptive manner. This type of content surely ensures the participants explore themselves. Hope you deliver the same near the future as well. Gratitude to the blogger for the efforts.

    Machine Learning Course in Bangalore

    ReplyDelete
  32. I feel very grateful that I read this. It is very helpful and very informative and I really learned a lot from it.
    Data Analytics Course

    ReplyDelete
  33. I am really enjoying reading your well written articles. I am looking forward to reading new articles. Keep up the good work.
    Data Science Courses in Bangalore

    ReplyDelete

  34. I am sure it will help many people. Keep up the good work. It's very compelling and I enjoyed browsing the entire blog.
    Business Analytics Course in Bangalore

    ReplyDelete
  35. Incredible blog here! It's mind boggling posting with the checked and genuinely accommodating data. Bane Coat

    ReplyDelete
  36. I read blogs on a similar topic, but I never visited your blog. I added it to favorites and I’ll be your constant reader. Arthur Morgan Jacket

    ReplyDelete

  37. Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.


    bulletintech
    jay cutler bodybuilder net worth
    ella rose mann
    staffing alternatives
    brad williams wife
    persona 5 fusion
    coryxkenshin dead
    Jana Kramer
    amber lancaster
    master root apk

    ReplyDelete
  38. This blog is very informative. Packing can be a long hectic process but it can be made easier by following the tips that you have mentioned above. Thanks for sharing such important and useful information. Keep it up.
    visit mentioned website for printing services.
    custom gift packaging
    Packaging boxes wholesale
    Custom candy packaging
    cake boxes wholesale

    ReplyDelete
  39. You know your projects stand out from the crowd. There is something special about them. I think they're all really cool!

    Business Analytics Course in Durgapur

    ReplyDelete
  40. Excellent effort to make this blog more wonderful and informative. The information shared was very useful.
    Data Analytics Course in Chandigarh

    ReplyDelete
  41. Very nice job... Thanks for sharing this amazing and educative blog post!
    Data Science Course in Chandigarh

    ReplyDelete
  42. A good blog always contains new and exciting information, and reading it I feel like this blog really has all of these qualities that make it a blog.

    Data Science Training in Durgapur

    ReplyDelete
  43. Really, this article is truly one of the best in article history. I am a collector of old "items" and sometimes read new items if I find them interesting. And this one that I found quite fascinating and should be part of my collection. Very good work!

    Data Scientist Training in Bangalore

    ReplyDelete
  44. It would also motivate almost everyone to save this webpage for their favorite helper to help get the look published.

    Data Science Training in Patna

    ReplyDelete
  45. It is late to find this act. At least one should be familiar with the fact that such events exist. I agree with your blog and will come back to inspect it further in the future, so keep your performance going.

    Best Data Analytics Courses in Bangalore

    ReplyDelete
  46. Good blog and absolutely exceptional. You can do a lot better, but I still say it's perfect. Keep doing your best.

    Data Science Training in Nagpur

    ReplyDelete
  47. I read your excellent post. It's a great job. I enjoyed reading your post for the first time. I want to thank you for this publication. Thank you...

    Data Analytics Course in Patna

    ReplyDelete
  48. Its content is brilliant in many ways. I think it is an attractive and revealing material. Thank you very much for caring about your content and your readers.

    Business Analytics Course in Patna

    ReplyDelete
  49. Really impressed! Everything is a very open and very clear clarification of the issues. It contains true facts. Your website is very valuable. Thanks for sharing.

    Best Data Analytics Courses in Bangalore

    ReplyDelete
  50. Good blog and absolutely exceptional. You can do a lot better, but I still say it's perfect. Keep doing your best.

    Data Analytics Course in Nagpur

    ReplyDelete
  51. Its content is brilliant in many ways. I think it is an attractive and revealing material. Thank you very much for caring about your content and your readers.

    Data Science Course in Durgapur

    ReplyDelete
  52. This is just the information I find everywhere. Thank you for your blog, I just subscribed to your blog. It's a good blog.

    Best Data Analytics Courses in Bangalore

    ReplyDelete
  53. Good blog and absolutely exceptional. You can do a lot better, but I still say it's perfect. Keep doing your best.

    Data Science Training in Durgapur

    ReplyDelete
  54. First of all, you have a great blog. I will be interested in more similar topics. I see you have some very useful topics, I will always check your blog thank you.

    Data Science Training Institutes in Bangalore

    ReplyDelete
  55. I have read your article, it is very informative and useful to me, I admire the valuable information you offer in your articles. Thanks for posting it ...

    Business Analytics Course in Ernakulam

    ReplyDelete
  56. Happy to chat on your blog, I feel like I can't wait to read more reliable posts and think we all want to thank many blog posts to share with us.

    Data Science in Bangalore

    ReplyDelete
  57. Really impressed! Information shared was very helpful Your website is very valuable. Thanks for sharing.
    Business Analytics Course in Bangalore

    ReplyDelete
  58. This is an excellent article. I like this topic. This site has many advantages. I have found a lot of interesting things on this site. It helps me in so many ways. Thanks for posting this again.

    Data Analytics Course in Durgapur

    ReplyDelete
  59. 1xbet | 1xbet | Bet with a Bonus - RMC | Riders Casino
    1XBet allows you to bet on 1xbet korean any gri-go.com favourite poormansguidetocasinogambling.com horse races or any other sporting event. ✓ Get up to £300 + 200 Free Spins No Deposit casinosites.one

    ReplyDelete
  60. Good blog and absolutely exceptional. You can do a lot better, but I still say it's perfect. Keep doing your best.

    Data Scientist Training in Bangalore

    ReplyDelete
  61. You know your projects stand out from the crowd. There is something special about them. I think they're all really cool!

    Business Analytics Course in Durgapur

    ReplyDelete
  62. Register for the Data Scientist courses in Bangalore and learn to build your Data Science and Machine learning workflows. Build a portfolio of work to have on your resume with live projects which are supported by an industry-relevant curriculum. Get Access to our learning management system (LMS) that provides you with all the material and assignments that will help you master all the concepts for you to solve any problem related to deciphering the hidden meaning in data.

    Data Science Training and Placement in Bangalore

    ReplyDelete
  63. Once you have chosen the correct mattress, you will now want to protect your investment. custom truck mattress

    ReplyDelete
  64. This blog is informative us.production company near me We provide services in town.

    ReplyDelete

  65. An Instagram accounts can be deleted quickly and easily. Log into your account first using a web browser or mobile app before using Instagram. Your account can be made inactive by using the profile options. Instagram won't prompt you to explain what you did if you don't finish this step.







    Readmore
    Instaguide.Info

    Android 13 is predicted for Motorola

    released a formal update timetable

    ReplyDelete
  66. If you enjoy playing games and are a fan of Taylor Swift, Swiftle is the ideal option. Since it combines the seductive worlds of video games and Taylor Swift's music, Swiftle is a unique and exhilarating experience. Players may face a range of difficulties as they go through the game's levels, which were designed by well-known Taylor Swift songs and albums.

    ReplyDelete
  67. The possibilities for building new virtual worlds are essentially limitless for players of the well-known sandbox game Minecraft. Fountains stand out among the various architectural marvels you may build in Minecraft as being both aesthetically pleasing and useful additions to your works of art. You may unleash your imagination and turn an ugly location into a compelling focal point by creating a fountain in Minecraft.

    ReplyDelete