Call Sales +1 (720) 930-4239 | Email Sales sales@flux.ly — Call Support +1 (720) 441-1844 | Email Support support@flux.ly
Job Scheduling and File Transfer
When utilizing a batch job scheduler like Flux, how does one process multiple files concurrently? Many batch schedulers execute workflows that process a file one at a time and from beginning to end. These files are scheduled to run through a workflow while many are ready to process. Given this scenario, files begin to back […]
Transferring files using a batch job scheduler with fine-grained control and configuration at runtime is a key and often used Flux feature. The following describes one such Flux workflow developed for a large mortgage broker in their transfer and tracking of mortgage files. The same model is in use in insurance, invoicing, logistics, and many […]
Batch job schedulers are often viewed as simply triggering jobs based on calendar or time events, e.g., run monthly reports at the end of the month at 10PM. But job schedulers need to support many other triggering events (i.e., dependencies) beyond calendar or time-based events. Consider this common case: run customer reports at the end […]
Batch Job Schedulers: Doing more than simply scheduling From fraud detection to payment clearing and digital media translation, many SaaS providers bring additional value for batch scheduled data feeds provided by their customers. They also use a wide range of methods for data collection and transfer from their customers – often slow, error-prone, and difficult […]
Batch Job Scheduling Batch job scheduling is a key and often overlooked facility of modern enterprise systems. Although considered ‘low-tech’ in this age of streaming video, mobile, big data, and high-speed messaging, much of an enterprise’s day to day processing taking place today is via scheduled batch jobs. Batch job scheduling is frequently addressed in […]
How does Flux make file transfer workflows easier? A Frequent Question An example of a frequent query (edited here for clarity) received by our technical support staff: “… we have a lot of file transfers that all implement the same logic. So we’d like to design this logic once and then just feed the transfer […]
The number and kinds of batch scheduling workflows are diverse. One valuable category of batch job scheduling activity is the scheduling and processing of digital media into on-line catalogs. The nature of digital media varies widely, from audio files to digital photos and movies to PDF-formatted contracts and legal documents. Frequently this media is processed […]
There exist many kinds of batch schedules. These schedules may vary in complexity but can still share a high degree of commonality. Simply categorizing your batch schedules affords insight into this commonality and offers opportunity to simplify or find other scheduling opportunities. Some batch schedule categories are provided below as candidate guidance to jumpstart organizing […]
Support for Daylight Saving Time (“DST”) within job schedulers varies widely. Different schedulers handle DST differently. An often-asked question of users of schedulers is “what happens during a DST event?” Flux provides two types of scheduling definitions – cron-style and relative time expressions.
Workload automation sounds simple at its surface. A business consumer (e.g., a department head or a senior executive) may state requirements in “if this, then that” form: If a department budget file arrives, validate it and send to the accounting system for processing. At midnight, backup and index the payroll database. On demand, generate an […]
The start of the new year is a time of reflection – reflecting on past new years’ resolutions and now considering new resolutions. Consider your automation initiatives during this reflection. Were your prior initiatives successful, and if so, what truly was the value they created? Were the results satisfying and long term? What new initiatives […]
There exists many forms of workload automation (WLA), ranging from scheduling recurring jobs such as database tasks, DevOps tasks involving software build and deployments, to virtual machine and container provisioning for software rollouts. Another significant workload automation area is that involving file processing. The job scheduling of file-related activities can vary from very simple to […]
Job scheduling and batch processing often involve the processing of files. The approach taken to naming and organizing your jobs’ files can significantly impact your ability to find those files later and to understand what they contain. The Smithsonian lists five precepts for its file naming and organization to make it obvious where to find […]
Flux provides a powerful set of facilities to control the order of execution of workflows on a Flux engine. When multiple workflows are waiting to be executed on a Flux engine, the engine must determine which workflow should be executed next. To make this decision, the engine considers three primary factors: Eligible Execution Time, Priority, […]
Flux’s variables and variable managers provide a powerful vehicle to pass data through a workflow to govern the processing and decision-making that takes place. Using variables can reduce the number of workflows that need to be created since an individual workflow can be made to “flex” depending upon the data it creates and encounters. Variables […]
Describing time – even in a job scheduler – is not a trivial matter. While Flux does not provide a plutonium reactor and a capacitor, Flux does provide a clean and concise way to describe time. Time expressions are simple, compact, textual representations of time- and date-based schedules. Time expressions are used in several places […]
Time expressions are simple, compact, textual representations of time- and date-based schedules. Time expressions are used in several places throughout Flux (including engine configuration options as well as trigger and action properties) to specify when and how often particular tasks will execute on the Flux scheduling engine. Time expressions make it easy to instruct workflows […]
Jobs-as-Code denotes a capability of maintaining application workflows, workloads, and jobs as software artifacts that can be managed using existing version control and deployment toolchains. Today most workload automation tools maintain their definitions and executions in proprietary tools and formats that are not amenable to standard development and deployment practice. Some examples of common workflows […]
From Scheduling Tasks to Automating Jobs Scheduling tasks in organizations is a common need. Grouping these tasks into cohesive units called ‘jobs’ and then automating these jobs allows IT staff to manage thousands of individual tasks with higher levels of quality, reliability, and productivity. Automating job scheduling reduces manual interventions and unnecessary delays while increasing […]
When evaluating job scheduling software to handle mission-critical business processes, it doesn’t matter if you’re building, buying, or open-sourcing, it is critical that the software improves system efficiencies and is able to be managed without requiring costly intervention. Your project may require more specific capabilities, like web services integration or PGP encryption, but to ensure […]
Must-Have’s for Trouble-Free File Transfers When you embark on a new managed file transfer project or you just want to review your existing file transfer processes, here are 5 things for you to review in order to make your system more trustworthy to everyone involved and to create smoothly running processes that require minimal human […]
Flux 8.0.13 continues Flux’s commitment to providing strong value within a reasonably priced solution to the workflow marketplace. Flux 8.0.13 improvements simplify the development, deployment, migration, and monitoring of your enterprise’s batch processes. Its new user interface, named ‘Flux Cockpit,’ offers a lean, flat, and consistent user experience. Default settings and new layout features allow […]
Workload automation is highly desirable. It saves time, reduces errors, and allows you to focus on other aspects of your business. Tapping into tools that allow for greater efficiency therefore becomes vital – and Flux has a variety of tools for you to explore. Intuitive Workflow Designer You can be more efficient with an intuitive […]
Big data is not easy, and the management strategies that follow are certainly not easy. This is why it’s critical for you to focus on IT workload automation. The more you can automate, the more you can do in other aspects of your job and know that all is being taken care of. Organizing the […]
In today’s world, there are more technological tools than ever. This makes it possible to enjoy a higher level of file orchestration and automation. WLA (workload automation) can lead to a lower amount of time spent on tasks and a lower cost of deployment. Flux was recently listed as a WLA strong value in the […]
Our lives and information exist in the form of data. If an individual or an organization gets their hands on our files, they can disrupt our personal lives, or in the case of companies, competitors or hackers could use the information to significantly damage business. For this very reason, businesses need to understand how to […]
New Features and Improvements to Workflow Orchestration Flux announces Flux 8.0.12, Flux’s latest version of its workflow and managed file platform. Flux is built on a unique clustered and distributed architecture that runs embedded in Java applications or as a standalone application managing mission critical batch processes on Windows, Linux, and Unix. New features Flux […]
The following workflow template (i.e.,” /MFT/Template”) illustrates an example workflow demonstrating Flux’s MFT capabilities. This reusable and configurable workflow template can be deployed to a Flux engine to execute any number of exchange file transfers. For example, submitting the template to a Flux engine as the name “/Acme/weekly” will force the engine to configure the […]
One of the least productive uses of staff time is manually determining when to run particular tasks. Sometimes tasks are simply time based, such as running reports at the end of the month or end of week. But often the requirements are a bit more complex. In such instances the utility of some kind […]
It is very typical for someone looking at a file orchestration system like Flux to already have a suite of “home grown” scripts that they’ve been using, or other external executables. The common question that comes from this is: Can Flux call on and orchestrate these external executables that are already in place? TL;DR: Absolutely! […]
Many organizations run Flux environments in mission-critical systems. The following outlines some basic documents and tasks that help support the overall care and maintenance of a Flux environment. Documenting a Flux Environment The following information should be kept in an editable document, reviewed quarterly, and made available to Flux Support Personnel when requested for assisting […]
There are instances where processes – such as database scripts (not just SQL statements) and operating system commands – require running under a different user than the user, or the service account, that is running Flux. Java provides no means to start processes as a different user than the one that started the Java virtual […]
Flux is pleased to announce the upcoming release of Flux 7.11.5. Depending on customer use case, this release can be expected to improve performance 20 – 200%. New for 7.11.5: Support for the HSQL in-memory database Compatability with Java 7 and Java 8 Improved performance of SFTP file transfers and overall engine performance Full release […]
How does Flux interact with remote servers that are secured using SSH? Since the release of Flux 8.0.10, we have implemented support for SSH based interactions with remote servers in your enterprise workflows. Workflows and file orchestrations now interact cleanly with the enterprise’s existing public key infrastructure, while still enjoying Flux’s powerful integration capabilities. New […]
Numerous Flux customers run Flux on AWS. A two engine Flux cluster with an Oracle RDS backend was configured and set up using Windows servers in just an hour. Total cost for this environment is about 6.00 USD per day for a basic configuration. Here’s a quick task list to get you started running Flux […]
Prepare and Read CSV File, Do Something with the Text in the File (Intermediate — Requires Light Scripting) It’s pretty common to receive a file from a customer and have to do some processing using the info in that file. This workflow polls a landing folder for a customer file (in the example […]
Here at Flux, we’re excited to finish the year with a !bang and set ourselves up for an excellent 2016, and we’re pretty sure you are too. If you’re a Flux user, make sure you’re getting the most out of your file orchestration and job scheduling system: Have you updated to Flux 8? There are […]
Edit, Verify, and Promote Flux workflows and configurations The Flux Repository is a storage space in the Operations Console for template workflows and other useful components in Flux like an engine or agent configuration. Once a workflow is saved to the Repository, it’s available for editing at any time by any user with sufficient permissions […]
With Flux, to design multi-step workflows — complete with dependencies, conditional branching, and looping — you don’t need to be a software developer. Drag-and-drop visual workflow creation defines workflows without scripting and allows staff to visualize workflow logic, without having to resort to complex and non-intuitive scripting. Actions, triggers, and other processes are […]
One of the most popular features of Flux is the ability to make workflows reusable by using namespaces and runtime variables. The Flux engine, at the time a workflow is submitted to an engine namespace, assigns values to workflows designed with runtime variables. Workflow runtime variables receive the values of namespace variables, making the workflows […]
Recently, an IT Consulting Service asked Flux about how the Flux job scheduler interacts with a database. The main question that was asked was: can Flux schedule database jobs by using TSQL or Stored Procedures for databases such as SQL Server, IBM DB2, and Oracle? And also, what type of database level details can Flux […]
Flux recently helped a large retail SaaS provider migrate 500+ shell scripts to Flux 8.0. Automating a few batch scripts is easy. Keeping track of over 500 is a bit more of a challenge. The workflows were easy — timed events coordinated across a dozen time zones triggering existing shell scripts (which Flux refers to […]
Flux 8.0.11 is here, and with it comes a host of performance and usability features: Flux 8.0.11 will now support the compilation and execution of Jasper Reports, a robust and open source Java reporting system that is available with commercial support options from TIBCO. Since Jasper reports can be executed through the command line, they […]
Flux was recently contacted by a company in the B2B EDI business. This company has an algorithm to transform file types, but needs assistance in other areas like workflow, monitoring directories and managing files. Their basic needs from Flux are: Monitor a directory, detect any files needing transfer, move file then delete file. Monitor a remote […]
How Flux manages complex ETL scripting with its file orchestrator Flux recently helped a large media and entertainment company who was looking for assistance orchestrating the execution of their suite of ETL scripts. The company uses Python scripts to run their ETL processes. This M&E company needs to be able to run multiple queries on […]
A number of long-standing Flux customers – some running on releases almost ten years old – have recently migrated to Flux 8. One top ten bank recently converted over 100,000 workflows to Flux 8. Flux 8.0.11 supports Java 7 and 8. And as always, Flux continues to develop and publish workflow examples to ease and […]
Flux is pleased to announce its upcoming release of Flux 8.0.11. This release includes: Integration with Jasper Reports to provide report creation and scheduling within Flux. The ability to web-provision workflows for immediate and scheduled execution. Numerous usability and performance improvements.
Insights on creating more efficient remote teams mentions Flux Software Advice, a firm helping businesses simplify the selection process of online project management software, just published new research that includes quotes from Ron Schultz, CEO of Flux regarding Flux’s approach to remote employees / teams. Flux’s file orchestration software is used in enterprises spanning the […]
Planning for Success with Automation As a manager, you’re considering replacing an existing system with an automated workflow platform. Perhaps you’ve found that too much of your time is spent allocating and managing resources for day-to-day tasks, and you aren’t able to spend as much time as you’d prefer focusing on larger business issues. Maybe […]
Moving beyond Scheduling Reports to Orchestrating Them Scheduling reports is a common use case for job schedulers. Often such scheduling is initially envisioned as a simple matter of setting a timer to fire off a report at a given time. In such cases available open source projects and even Windows Task Scheduler is used. But […]
Utilizing the concepts of agile development can provide direction and organization to your workflow development, making it more productive, yielding faster delivery, creating more flexible and reusable workflows, and increasing stakeholder satisfaction. Developing solutions involving workflows is by no means trivial. Workflows can be large, complex, and highly intricate. Often it’s difficult to determine where […]
File Orchestration vs. Managed File Transfer Ok, so you’ve figured out managed file transfer. You bought an out-of-the-box solution and – voila! – you’re up and running. It’s now ‘later’, maybe a few months or even years later. You come to realize that not only did you figure out managed file transfer, but other teams […]
Enterprise Scheduling and File Transfer Need to Integrate, Orchestrate, and Celebrate Your File Processes? Here’s 10 Things You Should Know. It’s work …whatever industry or environment you work with… sooner or later…. IT WILL CATCH UP TO YOU… Short cuts. Mistakes rushing to meet deadlines. Manual interventions. Struggles maintaining custom code. Late SLAs. No prioritization […]
The IT Manager’s Quest for Sleep This is not a story of vagaries and euphemisms. Unfortunately, this story is also often-told. This is a story starting with anguish and suffering. It may end with a happy ending, it may not. But it’s all about you – The IT Manager. You know the story. For all […]
There are several mistakes IT managers make that create major issues that can kill reaching the benefits of enterprise workflows. However, as damaging as these mistakes can be, they’re actually fairly easy to fix – all it takes is a little effort to improve design processes. Here are some of the more common problems along […]
The buy vs. build dilemma How did I get into this mess? Sometimes customers come to us when they realize they are being held hostage to internally developed software or processes that address job scheduling and managed file transfers. Over the years they see these turn into a Frankenstein of code and manual interventions. How […]
Flux and ETL One of the Use Cases for Flux Flux is used to create and execute automated workflows that involve a combination of steps and tasks across servers. Flux can initiate time-based schedules, batch jobs through scripting, interface with databases through SQL, and MFT (managed file transfer) activities through support of file transfer protocols […]
Simple workflow to initiate adhoc or on-demand file transfers Oftentimes we are asked what is the most effective way to initiate a file transfer. Our answer – it depends! But a common means of initiation is to have some executable process or customer software application prepare a file for transfer – and when that process […]
New features and bulk workflow operations coming in restyled monitor interface. The Flux Operations Console has served Flux users reasonably well over the years, but as users have scaled their operations to many hundreds and sometimes thousands of workflows, the Operations Console has shown its age. As illustrated below, the existing console does not provide […]
Data collection made easy for global healthcare provider using Flux With Growth Comes Added Workflow Complexity As businesses grow, what were once simple tasks often become unmanageable. Handling such growth effectively is a competitive advantage. Data collection tasks that were once simple, straightforward, and easy to manage often spiral in complexity as the business’s customers […]
Share with us the contact information for a friend or fellow developer (or even a manager!) who you think could benefit from Flux. We’ll send you one of these cool Flux T-shirts. Tadah!! Just sales@flux.ly or call us.
A common workflow for orchestrating digital media files The nature of digital media varies widely, from check images to digital photos to PDF- formatted contracts and legal documents. Yet the activities performed against digital media are often common and repeated. These repeatable activities are best expressed as a workflow — and often as a set […]
Must-Haves for Trouble-Free File Transfers When you embark on a new managed file transfer project or you just want to review your existing file transfer processes, here are 5 things for you to review in order to make your system more trustworthy to everyone involved and to create smoothly running processes that require minimal human […]
“How does one sell software if every other software in the same space is open source?” Here’s an interesting question, “How does one sell software if every other software in the same space is open source?” One would think that it would be an impossibility for a small company. However there’s a bright ray of […]
Looking for a Java job scheduler? After some searching and introspection, perhaps you arrive at some of the following choices: 1. Use a commercial Java job scheduler: Flux 2. Use an open source Java job scheduler: Quartz 3. Use something else 4. Develop something yourself Pretty quickly, you can make a “yes or no” decision […]
Flux supplies automated efficiency for content publication. Using Flux allows Interwoven to focus our precious resources to our core competencies. — Todd Scallan, OpenDeploy Product Manager, Interwoven The United Kingdom’s largest retail grocer, Tesco, had a problem. How could their web team manage Tesco’s dynamic web site where thousands of products were changing every day? […]
Flux is used as the cornerstone in a batch job framework that takes care of all the batch oriented processing in the system. This includes critical steps such as collecting transactional data and initiating the processing of the transactions. — Mats Fredriksson, System Architect, Mynta AB Mynta, a consultancy company located in Stockholm — Sweden’s […]
Flux activates the transformation and delivery of information from one healthcare application to another in the Synapse Scheduling Service. — Synapse Director of Engineering, Wellogic Wellogic provides healthcare integration solutions, clinical applications, and development consulting services to hospitals, healthcare practices, and other healthcare organizations. The Synapse Director of Engineering at Wellogic says, “We can provide […]
Consulting firm uses Flux to alleviate scheduling demands for clients You answer to a top-ten mortgage lender. Your job is to build a precise system to transfer data between disparate systems on a scheduled basis. Your consulting firm needs to deliver the solution on a timely basis for a competitive price. How do you […]
We chose to use Flux because we recognized Flux as a leader in the Java community. We trusted their good name and trusted their work. “We want to help our customers engage their users in valuable, long-lasting e-loyalty relationships,” says Mike Sick, UserMagnet’s Vice President of Development. As Sick knows, providing useful tools to e-business […]
Job Scheduling Serves Universal Business Models Documentum, a leading provider of enterprise content management (ECM), has over a decade of experience providing solutions to create, manage, deliver, and archive unstructured content. Building on these strengths, an increasing challenge for Documentum’s Global 2000 customer base was how to leverage the value of a powerful enterprise content […]
From java.sun.com Sims Computing’s Flux Enterprise Job Scheduler Computer job scheduling has been with us since 1960s-era mainframe systems, and was later more well established by the Unix(r) platform’s cron facility. In a nutshell, job scheduling is simply a matter of executing the correct task, on the correct day, and at the correct time. But […]
Flux Provides Automation Power and Reliability Chicago-based Adeptia, identifying the market void, created an innovative solution for data integration technology. Indigo is “integration middleware that WILL maximize the value of existing applications, enable disparate systems to communicate, extend the life of current systems, and allow collaboration of business partners, subsidiaries, buyers, and suppliers.” Adeptia points […]
Sims Computing created Flux, an enterprise component, using Java Technology Sims Computing was founded in 1997 as a boutique consulting shop to help build enterprise software components that would improve the overall efficiency and functionality of our customers’ enterprise applications. Working in this capacity with our customers, we quickly realized that there was a need […]
My goal is to help my clients by giving them good advice and developing high quality applications that can leverage their business and make them stronger. — Markus Torpvret, System Architect/Developer, Mind AB Mind AB System Architect Markus Torpvret sees a lot of Java development occurring in his neighborhood. While Stockholm, Sweden may not immediately […]
Companies of all stripes can benefit from job scheduling to automate processes in applications. Job scheduling is a simple way to add automated, unattended, scheduled processing to your Java applications. Many companies have discovered that job scheduling in J2EE and J2SE is a good way to automate applications and clean up system resources. Learn how […]
Sims Computing has released Flux 1.0, the Enterprise Job Scheduler. Job scheduling automates the process of determining when tasks need to be executed. Flux is a server-side Java software component that provides one-time and recurring job scheduling in Java 2 Enterprise Edition (J2EE) and Java applications.