You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Control nodes that generate changing values over separate executions of a workflow. Each time the workflow is executed, the value will be updated. This is useful for animating parameters in systems like [ComfyStream](https://github.com/yondonfu/comfystream) that execute the workflow once per frame.
3
+
A growing suite of nodes for real-time ComfyUI workflows. Features include value animation, motion detection and tracking, sequence control, and more. These nodes update their outputs on each workflow execution, making them perfect for real-time applications like [ComfyStream](https://github.com/yondonfu/comfystream) that execute the workflow once per frame.
4
+
5
+
The intention for this repository is to build a suite of nodes that can be used in the burgeoning real-time diffusion space. Contributions are welcome!
4
6
5
7
## Nodes
6
8
7
-
### Value Controls
9
+
### Value Controls 🎚️
8
10
-**FloatControl**: Outputs a floating point value that changes over time using various patterns (sine wave, bounce, random walk, etc).
9
11
-**IntControl**: Same as FloatControl but outputs integer values.
10
12
-**StringControl**: Cycles through a list of strings using the same movement patterns.
11
13
12
-
### Sequence Controls
14
+
### Sequence Controls 📽️
13
15
-**FloatSequence**: Cycles through a comma-separated list of float values.
14
16
-**IntSequence**: Cycles through a comma-separated list of integer values.
15
17
-**StringSequence**: Cycles through a list of strings (one per line).
16
18
17
-
### Motion Controls
19
+
### Motion Controls 🎮
18
20
-**MotionController**: Advanced float-based motion control for smooth animations.
19
21
-**IntegerMotionController**: Integer-based motion control for discrete value animations.
20
22
-**ROINode**: Region of Interest node for motion tracking and control.
21
23
22
-
### Utility Controls
24
+
### Utility Controls 🛠️
23
25
-**FPSMonitor**: Generates an FPS overlay as an image and mask, useful for monitoring performance.
24
26
-**QuickShapeMask**: Rapidly generate shape masks (circle, square) with customizable dimensions.
25
27
-**DTypeConverter**: Convert masks between different data types (float16, uint8, float32, float64).
26
28
-**FastWebcamCapture**: High-performance webcam capture node with resizing capabilities.
27
29
28
-
### VAE Tools
30
+
### VAE Tools 🖼️
29
31
-**TAESDVaeEncode**: TAESD VAE encoding node.
30
32
-**TAESDVaeDecode**: TAESD VAE decoding node.
31
33
32
-
## Movement Patterns
34
+
## Movement Patterns 🔄
33
35
34
36
All value and motion controls support various movement patterns:
35
37
-**Sine**: Smooth sinusoidal motion
@@ -39,7 +41,7 @@ All value and motion controls support various movement patterns:
39
41
-**Static**: No movement (constant value)
40
42
-**and more**
41
43
42
-
## Usage
44
+
## Usage 📖
43
45
44
46
### Value Controls
45
47
Connect any value control node to the input of the node you want to animate. These nodes use movement patterns like sine, bounce, etc. to smoothly transition between values.
@@ -59,27 +61,27 @@ Sequence controls allow you to specify exact values to cycle through. You can co
59
61
### FPS Monitor
60
62
Outputs an image and mask showing current and average FPS. Useful for performance monitoring in real-time workflows.
61
63
62
-
## Examples
64
+
## Examples 🎬
63
65
64
66
### Value Control Demo
65
-
In this demo we are controlling the width and height of a shape mask with an Int Control node:
67
+
In this demo we are controlling the width and height of a shape mask with an Int Control node. Imagine controlling the denoise on a KSampler with a Float Control, though! Or CFG in StreamDiffusion!
66
68

67
69
68
-
### Motion Active Blur Demo
69
-
Example of motion-based active blur effect:
70
+
### Motion Detection Blur Demo
71
+
Example of motion-based active blur effect running in ComfyStream. The action here is to control the blur amount of the frame here, but imagine if the action was "fire weapon":
70
72

71
73
72
-
## Installation
74
+
## Installation 💻
73
75
74
-
### Option 1: ComfyUI Manager (Coming soon!!)
75
-
~~The easiest way to install is through [ComfyUI Manager](https://github.com/ltdrdata/ComfyUI-Manager):~~
76
-
~~1. Install ComfyUI Manager if you haven't already~~
77
-
~~2. Open ComfyUI~~
78
-
~~3. Navigate to the Manager tab~~
79
-
~~4. Search for "Control Nodes"~~
80
-
~~5. Click Install~~
76
+
### Option 1: ComfyUI Manager 📦
77
+
The easiest way to install is through [ComfyUI Manager](https://github.com/ltdrdata/ComfyUI-Manager):
78
+
1. Install ComfyUI Manager if you haven't already
79
+
2. Open ComfyUI
80
+
3. Navigate to the Manager tab
81
+
4. Search for "Control Nodes"
82
+
5. Click Install
81
83
82
-
### Option 2: Manual Installation
84
+
### Option 2: Manual Installation ⚙️
83
85
1. Clone this repository into your ComfyUI custom_nodes folder:
84
86
```bash
85
87
cd ComfyUI/custom_nodes
@@ -92,9 +94,9 @@ cd ComfyUI_RealTimeNodes
92
94
pip install -r requirements.txt
93
95
```
94
96
95
-
## Coming Soon
97
+
## Coming Soon 🚀
96
98
97
-
### Advanced Detection System
99
+
### Advanced Detection System 👁️
98
100
The next major update will introduce a comprehensive detection system with multiple detector types:
99
101
-**Motion Detection**: Enhanced motion detection with configurable sensitivity and regions
100
102
-**Object Detection**: Real-time object detection and tracking
@@ -104,24 +106,24 @@ The next major update will introduce a comprehensive detection system with multi
104
106
105
107
These detection systems will provide powerful inputs for real-time ComfyUI workflows, enabling dynamic responses to various types of detected changes in the input stream.
106
108
107
-
## Project Status
109
+
## Project Status 📊
108
110
109
111
This is an evolving project that aims to expand the real-time capabilities of ComfyUI. As real-time use cases for ComfyUI continue to emerge and grow, this project will adapt and expand to meet those needs. The goal is to provide a comprehensive suite of tools for real-time workflows, from simple value animations to complex detection and response systems.
110
112
111
-
### Contributing
113
+
### Contributing 🤝
112
114
113
115
Your feedback and contributions are more than welcome! This project grows stronger with community input.
114
116
115
-
- Have an idea? Open an issue!
116
-
- Found a bug? Open an issue!
117
-
- Made an improvement? Submit a PR!
118
-
- Want to help? Join the discussion!
117
+
- Have an idea? Open an issue! 💡
118
+
- Found a bug? Open an issue! 🐛
119
+
- Made an improvement? Submit a PR! 🎉
120
+
- Want to help? Join the discussion! 💬
119
121
120
122
Please visit our [GitHub Issues](https://github.com/ryanontheinside/ComfyUI_RealTimeNodes/issues) page to contribute.
Make anything react to anything in your ComfyUI workflows. [ComfyUI_RyanOnTheInside](https://github.com/ryanontheinside/ComfyUI_RyanOnTheInside) - my main custom nodes suite that brings complete reactive control to standard ComfyUI workflows:
126
128
127
129
- Dynamic node relationships
@@ -137,4 +139,4 @@ Make anything react to anything in your ComfyUI workflows. [ComfyUI_RyanOnTheIns
137
139
- Reactive DepthFlow
138
140
- Actually more
139
141
140
-
Use it alongside these Control Nodes to master both the batch and real-time paradigms in ComfyUI.
142
+
Use it alongside these Control Nodes to master parameter control in both the batch and real-time paradigms in ComfyUI! The POWER!!
0 commit comments