Tweakstreet
v1.22.6
Enter search terms
User Forum
Support Portal
Concepts › Steps
Getting started
⌃
Installation
Configuration
Tutorials
⌃
Your First Data Flow
User Interface
⌃
Flow Canvas
Markdown Descriptions
Editing Expressions
Run Flow Dialog
Command Line
⌃
Running in Docker
Tweakflow REPL
Running Flows
Concepts
⌃
Flows
⌃
Control Flows
Data Flows
Flow Variables
Steps
⌃
Steps Overview
Step Variables
Expressions
Modules
Config Modules
Examples
⌃
Building a Date Dimension
SHA and MD5 hashing
Steps
⌃
Database
⌃
BigQuery Input
BigQuery Table Input
Interface Output
Junk Dimension
Kafka Producer
MongoDB Aggregate
MongoDB Command
MongoDB Delete
MongoDB Find
MongoDB Insert
MongoDB Update or Raplace
Slowly Changing Dimension
Slowly Changing Dimension Lookup
SQL Input
SQL Insert
SQL Insert or Update
SQL Lookup
SQL Script
Files
⌃
File exists?
Archive Files
Copy Files
Create Folder
CSV Input
CSV Output
Delete Files
Deserialize
Excel Input
Excel Output
File Info
Find Files
Get Files
Move Files
ORC Output
Read Binary File
Read Excel File
Read File
Read SAS File
Read XBase File
Serialize
Write to File
XML Input
Network
⌃
Http Request
Flows
⌃
Start
Finish
Abort
Breaker
Flow Result
Run Flow
Logic
⌃
Calculator
Python
Stateful Calculator
Value Mapper
Stream
⌃
Append Streams
Decision
Filter
Pick Fields
Transform Fields
Stream Lookup
Diff on Sorted Keys
Distinct
Group By
Join on Condition
Join on Sorted Keys
Rows Exist
Sort
System
⌃
Clock
Network Info
Run Process
System Info
Utility
⌃
Block Until Finished
Counter
Data Table
Freemarker
Generate Rows
GUID
Heartbeat
Index Distinct
Interface Input
List to Rows
Logger
Look ahead/behind
Mustache
Random Data
Send Mail
Sleep
Split to Fields
Sub Flow
Throttle
Expressions
⌃
Computations
⌃
crypto
⌃
hash
data
⌃
contains
has
is empty
keys
size
values
data - selection
⌃
filter
find
find index
find last
find last index
get
get in
head
initial
last
omit
range
select
slice
tail
data - transforms
⌃
append
concat
delete
drop
group by
group deep by
index by
index deep by
insert
map
merge
prepend
put
put in
reduce
repeat
reverse
slices
take
unique
update
update in
json
⌃
parse JSON
stringify JSON
strings
⌃
capture
ends with
index of
join
last index of
length
lower case
matches
replace
scan
split
starts with
substing
trim
upper case
time
⌃
add duration
add period
end of month
from unix timestamp
make
midnight
same instant at zone
unix timestamp
time - between
⌃
days between
duration between
hours between
minutes between
months between
period between
seconds between
years between
time - get
⌃
day of month
day of week
day of year
hour
minute
month
nanosecond
offset seconds
quarter
second
time zone
week of year
year
time - set
⌃
set day of month
set hour
set minute
set month
set nanoseconds
set second
set time
set time zone
set year
urls
⌃
percent-decode
percent-encode
Parsers
⌃
Boolean Parser
Datetime Parser
JSON Parser
Number Parser
String Parser
Formatters
⌃
Datetime Formatter
Number Formatter
JSON Formatter
Aggregators
⌃
Average
Collect
Collect Distinct
Count
Count Distinct
Earliest
First
Last
Latest
Max
Min
Sum
Comparators
⌃
Compare datetimes
Compare numbers
Compare strings
Compare strings using locale
Generators
⌃
Generate address
Generate color
Generate datetime
Generate dict
Generate from list
Generate list
Generate number
Generate person
Generate string
Generate text
Generate vehicle
Generate word
Generate workplace
Widgets
⌃
Boolean
Charsets
Data Grid
Database Schema
Database Table
Datetime
Datetime Pattern
Dict
Field Reference
File
Formula
Line Ending
List
Locale
Mongodb Collection
Mongodb Database
Nil
Non-Printable Characters
Number
Number Patterns
Password
Records
Reference
Row Reference
Separators
Step Result
String
Text
Timezones
Services
⌃
Filesystems
⌃
Filesystem Definition
Filesystem Reference
Local
Apache vfs2
S3
Databases
⌃
Database Definition
Database Reference
Generic
DB2
MySQL 5.x
MySQL 8.x
Oracle
Postgres
Snowflake
SQL Server
Kafka
⌃
Kafka Definition
Kafka Reference
Generic
MongoDB
⌃
MongoDB Definition
MongoDB Reference
Generic
Connection String
Smtp Mail Server
⌃
Smtp Definition
Smtp Reference
Generic
Local Default
OAuth 2.0
⌃
OAuth 2.0 Definition
OAuth 2.0 Reference
Generic
Google Service Account
Hadoop
⌃
Hadoop Definition
Hadoop Reference
Generic
Default
Other
⌃
BSON
Excel Cell Format
Modules
⌃
std
std/spec
tweakstreet/crypto
tweakstreet/json
tweakstreet/modules
tweakstreet/soup
tweakstreet/spec
tweakstreet/system
tweakstreet/xml
Steps
Step Variables
Steps Overview
On this page
Steps