Home eBooks Download › concurrent data processing in elixir

Concurrent Data Processing In Elixir

Download Concurrent Data Processing In Elixir PDF/ePub or read online books in Mobi eBooks. Click Download or Read Online button to get Concurrent Data Processing In Elixir book now. This website allows unlimited access to, at the time of writing, more than 1.5 million titles, including hundreds of thousands of titles in various foreign languages. If the content not found or just blank you must refresh this page

Concurrent Data Processing In Elixir

DOWNLOAD
Author : Svilen Gospodinov
language : en
Publisher: The Pragmatic Programmers LLC
Release Date : 2021-07-25

Concurrent Data Processing In Elixir written by Svilen Gospodinov and has been published by The Pragmatic Programmers LLC this book supported file pdf, txt, epub, kindle and other format this book has been release on 2021-07-25 with Computers categories.

Learn different ways of writing concurrent code in Elixir and increase your application's performance, without sacrificing scalability or fault-tolerance. Most projects benefit from running background tasks and processing data concurrently, but the world of OTP and various libraries can be challenging. Which Supervisor and what strategy to use? What about GenServer? Maybe you need back-pressure, but is GenStage, Flow, or Broadway a better choice? You will learn everything you need to know to answer these questions, start building highly concurrent applications in no time, and write code that's not only fast, but also resilient to errors and easy to scale. Whether you are building a high-frequency stock trading application or a consumer web app, you need to know how to leverage concurrency to build applications that are fast and efficient. Elixir and the OTP offer a range of powerful tools, and this guide will show you how to choose the best tool for each job, and use it effectively to quickly start building highly concurrent applications. Learn about Tasks, supervision trees, and the different types of Supervisors available to you. Understand why processes and process linking are the building blocks of concurrency in Elixir. Get comfortable with the OTP and use the GenServer behaviour to maintain process state for long-running jobs. Easily scale the number of running processes using the Registry. Handle large volumes of data and traffic spikes with GenStage, using back-pressure to your advantage. Create your first multi-stage data processing pipeline using producer, consumer, and producer-consumer stages. Process large collections with Flow, using MapReduce and more in parallel. Thanks to Broadway, you will see how easy it is to integrate with popular message broker systems, or even existing GenStage producers. Start building the high-performance and fault-tolerant applications Elixir is famous for today. What You Need: You'll need Elixir 1.9+ and Erlang/OTP 22+ installed on a Mac OS X, Linux, or Windows machine.

Concurrent Data Processing In Elixir

DOWNLOAD
Author : Svilen Gospodinov
language : en
Publisher:
Release Date : 2021

Concurrent Data Processing In Elixir written by Svilen Gospodinov and has been published by this book supported file pdf, txt, epub, kindle and other format this book has been release on 2021 with categories.

Concurrent Data Pipelines With Broadway In Elixir

DOWNLOAD
Author : William Smith
language : en
Publisher: HiTeX Press
Release Date : 2025-07-13

Concurrent Data Pipelines With Broadway In Elixir written by William Smith and has been published by HiTeX Press this book supported file pdf, txt, epub, kindle and other format this book has been release on 2025-07-13 with Computers categories.

"Concurrent Data Pipelines with Broadway in Elixir" Unlock the full potential of data-intensive application design with "Concurrent Data Pipelines with Broadway in Elixir." This comprehensive guide takes readers from the foundational principles of concurrency and parallelism on the BEAM virtual machine, through the architectural intricacies of Broadway, Elixir’s premier data processing library. With detailed explorations of process isolation, message passing, and supervision trees, this book provides both the theoretical underpinnings and practical insights required to build robust, scalable, and fault-tolerant systems. It delves into GenStage’s influence on Broadway, guiding engineers to leverage Elixir’s unique strengths for event-driven workflows. Beyond the core architecture, the book offers an authoritative roadmap for integrating Broadway with diverse data sources—ranging from message queues like RabbitMQ and Kafka to custom APIs and streaming file inputs. Readers will master advanced processor patterns, batching strategies, and real-world output routing scenarios, ensuring consistent performance under heavy and unpredictable loads. Emphasis is placed on error handling, back-pressure mechanisms, transactional guarantees, and ensuring idempotency both at input and output stages—a must for reliable, production-grade data flows. Operational excellence is a central theme, with in-depth coverage of observability, telemetry, benchmarking, and reliability engineering. From scaling across distributed environments and implementing Kubernetes operator patterns, to safeguarding pipelines with modern security, compliance, and governance best practices, the book prepares you for the complexities of enterprise deployment. Concluding with advanced patterns, machine learning integration, and real-world case studies, "Concurrent Data Pipelines with Broadway in Elixir" is the definitive resource for any engineer or architect seeking to build, operate, and evolve next-generation data pipelines in Elixir.

Machine Learning In Elixir

DOWNLOAD
Author : Sean Moriarity
language : en
Publisher: The Pragmatic Programmers LLC
Release Date : 2024-08-27

Machine Learning In Elixir written by Sean Moriarity and has been published by The Pragmatic Programmers LLC this book supported file pdf, txt, epub, kindle and other format this book has been release on 2024-08-27 with Computers categories.

Stable Diffusion, ChatGPT, Whisper - these are just a few examples of incredible applications powered by developments in machine learning. Despite the ubiquity of machine learning applications running in production, there are only a few viable language choices for data science and machine learning tasks. Elixir's Nx project seeks to change that. With Nx, you can leverage the power of machine learning in your applications, using the battle-tested Erlang VM in a pragmatic language like Elixir. In this book, you'll learn how to leverage Elixir and the Nx ecosystem to solve real-world problems in computer vision, natural language processing, and more. The Elixir Nx project aims to make machine learning possible without the need to leave Elixir for solutions in other languages. And even if concepts like linear models and logistic regression are new to you, you'll be using them and much more to solve real-world problems in no time. Start with the basics of the Nx programming paradigm - how it differs from the Elixir programming style you're used to and how it enables you to write machine learning algorithms. Use your understanding of this paradigm to implement foundational machine learning algorithms from scratch. Go deeper and discover the power of deep learning with Axon. Unlock the power of Elixir and learn how to build and deploy machine learning models and pipelines anywhere. Learn how to analyze, visualize, and explain your data and models. Discover how to use machine learning to solve diverse problems from image recognition to content recommendation - all in your favorite programming language. What You Need: You'll need a computer with a working installation of Elixir v1.12 and Erlang/OTP 24. For some of the more compute intensive examples, you'll want to use EXLA, which currently only supports x86-64 platforms. While not explicitly required, some examples will demonstrate programs running on accelerators such as CUDA/ROCm enabled GPUs and Google TPUs. Most of these programs will still run fine on a regular CPU, just for much longer periods of time.

Build A Weather Station With Elixir And Nerves

DOWNLOAD
Author : Alexander Koutmos
language : en
Publisher: The Pragmatic Programmers LLC
Release Date : 2022-01-06

Build A Weather Station With Elixir And Nerves written by Alexander Koutmos and has been published by The Pragmatic Programmers LLC this book supported file pdf, txt, epub, kindle and other format this book has been release on 2022-01-06 with Computers categories.

The Elixir programming language has become a go-to tool for creating reliable, fault-tolerant, and robust server-side applications. Thanks to Nerves, those same exact benefits can be realized in embedded applications. This book will teach you how to structure, build, and deploy production grade Nerves applications to network-enabled devices. The weather station sensor hub project that you will be embarking upon will show you how to create a full stack IoT solution in record time. You will build everything from the embedded Nerves device to the Phoenix backend and even the Grafana time-series data visualizations. Elixir as a programming language has found its way into many different software domains, largely in part to the rock-solid foundation of the Erlang virtual machine. Thanks to the Nerves framework, Elixir has also found success in the world of embedded systems and IoT. Having access to all of the Elixir and OTP constructs such as concurrency, supervision, and immutability makes for a powerful IoT recipe. Find out how to create fault-tolerant, reliable, and robust embedded applications using the Nerves framework. Build and deploy a production-grade weather station sensor hub using Elixir and Nerves, all while leveraging the best practices established by the Nerves community for structuring and organizing Nerves applications. Capture all of your weather station sensor data using Phoenix and Ecto in a lightweight server-side application. Efficiently store and retrieve the time-series weather data collected by your device using TimescaleDB (the Postgres extension for time-series data). Finally, complete the full stack IoT solution by using Grafana to visualize all of your time-series weather station data. Discover how to create software solutions where the underlying technologies and techniques are applicable to all layers of the project. Take your project from idea to production ready in record time with Elixir and Nerves. What You Need: To complete the Nerves weather station project in this book, you will need the following: A Linux, MacOS, or Windows computer to build and deploy Nerves firmware images A Raspberry Pi Zero W or any other Nerves supported target (https://hexdocs.pm/nerves/targets.html#supported-targets-and-systems) A VEML6030 light sensor An BME680 environmental sensor An SGP30 air quality sensor Qwiic connect cables for weather sensors

Designing Data Governance From The Ground Up

DOWNLOAD
Author : Lauren Maffeo
language : en
Publisher: The Pragmatic Programmers LLC
Release Date : 2023-01-18

Designing Data Governance From The Ground Up written by Lauren Maffeo and has been published by The Pragmatic Programmers LLC this book supported file pdf, txt, epub, kindle and other format this book has been release on 2023-01-18 with Computers categories.

Businesses own more data than ever before, but it's of no value if you don't know how to use it. Data governance manages the people, processes, and strategy needed for deploying data projects to production. But doing it well is far from easy: Less than one fourth of business leaders say their organizations are data driven. In Designing Data Governance from the Ground Up, you'll build a cross-functional strategy to create roadmaps and stewardship for data-focused projects, embed data governance into your engineering practice, and put processes in place to monitor data after deployment. In the last decade, the amount of data people produced grew 3,000 percent. Most organizations lack the strategy to clean, collect, organize, and automate data for production-ready projects. Without effective data governance, most businesses will keep failing to gain value from the mountain of data that's available to them. There's a plethora of content intended to help DataOps and DevOps teams reach production, but 90 percent of projects trained with big data fail to reach production because they lack governance. This book shares six steps you can take to build a data governance strategy from scratch. You'll find a data framework, pull together a team of data stewards, build a data governance team, define your roadmap, weave data governance into your development process, and monitor your data in production Whether you're a chief data officer or individual contributor, this book will show you how to manage up, get the buy-in you need to build data governance, find the right colleagues to co-create data governance, and keep them engaged for the long haul.

A Common Sense Guide To Data Structures And Algorithms In Python Volume 1

DOWNLOAD
Author : Jay Wengrow
language : en
Publisher: The Pragmatic Programmers LLC
Release Date : 2023-12-04

A Common Sense Guide To Data Structures And Algorithms In Python Volume 1 written by Jay Wengrow and has been published by The Pragmatic Programmers LLC this book supported file pdf, txt, epub, kindle and other format this book has been release on 2023-12-04 with Computers categories.

p>If you thought data structures and algorithms were all just theory, you're missing out on what they can do for your Python code. Learn to use Big O notation to make your code run faster by orders of magnitude. Choose from data structures such as hash tables, trees, and graphs to increase your code's efficiency exponentially. With simple language and clear diagrams, this book makes this complex topic accessible, no matter your background. Every chapter features practice exercises to give you the hands-on information you need to master data structures and algorithms for your day-to-day work. Algorithms and data structures are much more than abstract concepts. Mastering them enables you to write code that runs faster and more efficiently, which is particularly important for today's web and mobile apps. Take a practical approach to data structures and algorithms, with techniques and real-world scenarios that you can use in your daily production code. The Python edition uses Python exclusively for all code examples, exercise, and solutions. Use Big O notation to measure and articulate the efficiency of your code, and modify your algorithm to make it faster. Find out how your choice of arrays, linked lists, and hash tables can dramatically affect the code you write. Use recursion to solve tricky problems and create algorithms that run exponentially faster than the alternatives. Dig into advanced data structures such as binary trees and graphs to help scale specialized applications such as social networks and mapping software. You'll even encounter a single keyword that can give your code a turbo boost. Practice your new skills with exercises in every chapter, along with detailed solutions. Use these techniques today to make your Python code faster and more scalable.

Pythonic Programming

DOWNLOAD
Author : Dmitry Zinoviev
language : en
Publisher: The Pragmatic Programmers LLC
Release Date : 2021-09-23

Pythonic Programming written by Dmitry Zinoviev and has been published by The Pragmatic Programmers LLC this book supported file pdf, txt, epub, kindle and other format this book has been release on 2021-09-23 with Computers categories.

Make your good Python code even better by following proven and effective pythonic programming tips. Avoid logical errors that usually go undetected by Python linters and code formatters, such as frequent data look-ups in long lists, improper use of local and global variables, and mishandled user input. Discover rare language features, like rational numbers, set comprehensions, counters, and pickling, that may boost your productivity. Discover how to apply general programming patterns, including caching, in your Python code. Become a better-than-average Python programmer, and develop self-documented, maintainable, easy-to-understand programs that are fast to run and hard to break. Python is one of the most popular and rapidly growing modern programming languages. With more than 200 standard libraries and even more third-party libraries, it reaches into the software development areas as diverse as artificial intelligence, bioinformatics, natural language processing, and computer vision. Find out how to improve your understanding of the spirit of the language by using one hundred pythonic tips to make your code safer, faster, and better documented. This programming style manual is a quick reference of helpful hints and a random source of inspiration. Choose the suitable data structures for searching and sorting jobs and become aware of how a wrong choice may cause your application to be completely ineffective. Understand global and local variables, class and instance attributes, and information-hiding techniques. Create functions with flexible interfaces. Manage intermediate computation results by caching them in files and memory to improve performance and reliability. Polish your documentation skills to make your code easy for other programmers to understand. As a bonus, discover Easter eggs cleverly planted in the standard library by its developers. Polish, secure, and speed-up your Python applications, and make them easier to maintain by following pythonic programming tips. What You Need: You will need a Python interpreter (ideally, version 3.4 or above) and the standard Python library that usually comes with the interpreter.

Practical A B Testing

DOWNLOAD
Author : Leemay Nassery
language : en
Publisher: The Pragmatic Programmers LLC
Release Date : 2023-05-23

Practical A B Testing written by Leemay Nassery and has been published by The Pragmatic Programmers LLC this book supported file pdf, txt, epub, kindle and other format this book has been release on 2023-05-23 with Computers categories.

Whether you're a catalyst for organizational change or have the support you need to create an engineering culture that embraces A/B testing, this book will help you do it right. The step-by-step instructions will demystify the entire process, from constructing an A/B test to breaking down the decision factors to build an engineering platform. When you're ready to run the A/B test of your dreams, you'll have the perfect blueprint. With smart, tactful approaches to orchestrating A/B testing on a product, you'll quickly discover how to reap all the benefits that A/B testing has to offer - benefits that span your users, your product, and your team. Take the reins today, and be the change you want to see in your engineering and product organizations. Develop a hypothesis statement that's backed with metrics that demonstrate if your prediction for the experiment is correct. Build more inclusive products by leveraging audience segmentation strategies and ad-hoc post analysis to better understand the impact of changes on specific user groups. Determine which path is best for your team when deciding whether to go with a third-party A/B test framework or to build the A/B testing platform in-house. And finally, learn how to cultivate an experimentation-friendly culture within your team. Leverage the A/B testing methodology to demonstrate the impact of changes on a product to your users, your key business metrics, and the way your team works together. After all, if you aren't measuring the impact of the changes you make, how will you know if you're truly making improvements?

Python Brain Teasers

DOWNLOAD
Author : Miki Tebeka
language : en
Publisher: The Pragmatic Programmers LLC
Release Date : 2021-08-25

Python Brain Teasers written by Miki Tebeka and has been published by The Pragmatic Programmers LLC this book supported file pdf, txt, epub, kindle and other format this book has been release on 2021-08-25 with Computers categories.

We geeks love puzzles and solving them. The Python programming language is a simple one, but like all other languages it has quirks. This book uses those quirks as teaching opportunities via 30 simple Python programs that challenge your understanding of Python. The teasers will help you avoid mistakes, see gaps in your knowledge, and become better at what you do. Use these teasers to impress your co-workers or just to pass the time in those boring meetings. Teasers are fun! At the beginning of each chapter I'll show you a short Python program and will ask you to guess the output. The possible answers can be: Syntax error Exception Hang Some output (e.g. `[1 2 3]`) Here's how to approach the puzzles. Read through the code. Before moving on to the answer and the explanation, go ahead and guess the output. After guessing the output, run the code and see the output yourself. Finally proceed to read the solution and the explanation. The puzzles are short enough to solve on a coffee break, so carry them with you, have fun, and share them with co-workers. People who make mistakes during the learning process learn better than people who don't. If you use this approach at work when fixing bugs, you'll find you enjoy bug hunting more and become a better developer after each bug you fix. Many of these puzzles are from the author's lessons learned (and others) of shipping bugs to production. He often uses the puzzles as quizzes during conferences and meetups, and they tend to create a buzz of excitement. What You Need: You need to know Python at some level and have experience programming with it. NOTE: The book uses Python version 3.8.2 to run the code; the output _could_ change in future versions. You will need a working Python environment, you can download it from "python.org":https://www.python.org/downloads/. You will probably want a good IDE for python, two of the most popular ones are "Visual Studio Code":https://code.visualstudio.com/ and "PyCharm":https://www.jetbrains.com/pycharm/.

Concurrent Data Processing In Elixir

Recent Posts