26 Commits

Author SHA1 Message Date
dvirlabs
66df6c74ec fix: Normalize line endings in drift-check content comparison
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
CRITICAL FIX FOR WINDOWS:

Problem: Git on Windows uses CRLF, but deployed files use LF. When comparing
with slurp (byte-for-byte base64 comparison), CRLF != LF causes false positives.

Solution: Decode base64 content and normalize line endings:
  - Replace CRLF with LF in both Git and server file content
  - Then compare the normalized content

This ensures that line ending differences don't trigger false OUT_OF_SYNC alerts.
After deploy, content will match regardless of platform line ending differences.
2026-04-23 14:06:14 +03:00
dvirlabs
ac4278a451 fix: Simplify drift-check to avoid fsnotify watcher exhaustion
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
CRITICAL FIX:

Problem: Previous version used multiple stat operations and loops which created
too many file descriptors and fsnotify watchers, causing 'too many open files' errors.

Solution: Use only:
- slurp: Direct file content reading (no watchers)
- find: Single operation to list directory files (no loops)

New logic is clean and simple:
1. Read Git rsyslog.conf + server rsyslog.conf (slurp)
2. Compare content directly (byte comparison)
3. List Git rsyslog.d files + server rsyslog.d files (find)
4. Compare file names (no permission checks, no loops)
5. Output DRIFTED_FILES and SYNC_STATUS markers

This eliminates file descriptor exhaustion while maintaining correct drift detection.
After deploy, when content matches, playbook exits 0 (SYNCED).
2026-04-23 13:28:16 +03:00
dvirlabs
1cbe3d4de7 fix: Use checksum-based content comparison to avoid permission-based drift false positives
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
CRITICAL FIX:

Problem: drift-check.yml was using 'copy' module in check_mode, which compares:
  - File content ✓
  - Permissions (owner, group, mode) ✗
  - Ownership ✗

After deploy, files have root:root 0644 permissions. Even though content matches,
the copy module marked files as 'changed' because permissions were being compared.
This caused false OUT_OF_SYNC reports even when configuration was actually synced.

Solution: Use MD5 checksum-based comparison instead:
  - Compare only file CONTENT using stat checksums
  - Ignore permissions/ownership differences
  - This is what matters for config management

Also fixed URLs:
  - Changed back from port 80 to port 5000 (API only)
  - Updated service name to gitops-status-api

Now drift detection only triggers on actual config changes, not permission differences.
After successful deploy, should correctly report SYNCED status.
2026-04-23 13:21:20 +03:00
dvirlabs
380eaf175a fix: Resolve OUT_OF_SYNC false positive after successful deploy
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
CRITICAL FIXES:

1. Fix API URL port: 5000 → 80 (.woodpecker.yml)
   - update-gitops-status step was POSTing to wrong port
   - gitops-status-server Service exposes port 80, not 5000
   - This caused silent POST failures that weren't detected

2. Initialize missing_on_server variable (drift-check.yml)
   - Variable was only set inside block scope
   - Could remain undefined if block failed or didn't execute
   - Now initialized to empty list before block runs
   - Prevents undefined variable errors in container environment

3. Fix drift detection logic (drift-check.yml)
   - Changed from: drift_detected uses extra_files_on_server flag
   - Changed to: drift_detected directly checks missing_on_server length
   - Adds safety with | default([]) filter
   - Prevents false positives when extra_files_on_server wasn't set properly

ROOT CAUSE:
The combination of port 5000, uninitialized variables, and flag-based logic
caused the playbook to report OUT_OF_SYNC without listing changed files
(drift_count=0, files=[]). After deployment, server config matches Git,
so drift_detected should be false and playbook should exit 0 with SYNCED status.

Now correctly reports SYNCED after successful deploy.
2026-04-23 13:13:07 +03:00
dvirlabs
5285f4c241 debug: Add comprehensive debugging for drift detection and JSON POSTing
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
- Add debug output showing rsyslogd_check.diff structure
- Simplify file extraction logic for rsyslog.d directory changes
- Show full JSON payload before sending to API
- Add connectivity test to gitops-status-server before POST
- Show curl command and response codes for debugging
- Display warning if OUT_OF_SYNC but no files extracted

This helps diagnose why drift is detected but files aren't listed in the JSON.
2026-04-23 11:52:32 +03:00
dvirlabs
cdec5ce87c Debug api request
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
2026-04-23 11:40:17 +03:00
e8fed366b4 test
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
2026-04-23 00:35:03 +03:00
654259c7cd test
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
2026-04-22 22:56:11 +03:00
dvirlabs
fc8cb0c40e fix: Resolve 'too many open files' error in pipeline
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
- Remove -v verbose flag from ansible-playbook (was causing file descriptor exhaustion)
- Add recurse: false to find tasks (prevents recursive directory traversal)
- Set ulimit -n 4096 in Woodpecker container to increase FD limit
- Add ANSIBLE_* environment variables for container optimization:
  - ANSIBLE_HOST_KEY_CHECKING=False (skip SSH key verification)
  - ANSIBLE_CALLBACK_WHITELIST=minimal (reduce output verbosity)
  - ANSIBLE_FORCE_COLOR=False (no ANSI color codes)
  - ANSIBLE_RETRY_FILES_ENABLED=False (don't create retry files)

This resolves fsnotify watcher errors in container environments with low FD limits.
2026-04-22 21:54:00 +03:00
dvirlabs
f926b7eb0d Update drift-check to let the pipeline update also what files changed
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
2026-04-22 21:50:39 +03:00
dvirlabs
db28c9da82 Migrate from pushgateway to infinity
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
2026-04-21 12:41:09 +03:00
bfe9b5329b Fix drift check
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
ci/woodpecker/cron/woodpecker Pipeline was successful
2026-04-19 05:31:09 +03:00
4bea7cd356 Fix drift check
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
ci/woodpecker/cron/woodpecker Pipeline was successful
2026-04-19 05:21:35 +03:00
a9e415eae5 Add pushgateway svc
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
2026-04-19 04:44:50 +03:00
e7a7bcee4b test
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
2026-04-17 18:43:19 +03:00
2f580459d4 test
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
2026-04-17 18:16:46 +03:00
82a9274bf9 test
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
2026-04-17 17:30:55 +03:00
1a9ed6fc06 test
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
2026-04-17 17:07:29 +03:00
9e207bc2d3 test
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
2026-04-17 17:07:17 +03:00
d1c38826f3 test
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
2026-04-17 17:02:10 +03:00
227fb86b04 test
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
2026-04-17 16:57:22 +03:00
cb8d885061 Update the repo to work with remote servers
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
2026-04-17 16:33:35 +03:00
dvirlabs
1828ac5cd5 Add validate 2026-04-16 19:21:49 +03:00
dvirlabs
820947fb41 Add playbook 2026-04-13 16:03:21 +03:00
5e9a72b585 Update inventory 2026-04-13 12:54:18 +00:00
dvirlabs
1b4d9dcc0d Add ansible 2026-04-13 15:43:27 +03:00