gilles/scrutiny
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
113 Commits 15 Branches 51 Tags
7cdacbaffc96d2c8d555887a1fcb60b8e628f02b
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Jason Kulatunga 7cdacbaffc add information about how to generate debug logs 2020-09-21 22:27:59 -06:00
Jason Kulatunga 2fee2bf906 fix tests. 2020-09-21 21:22:07 -06:00
Jason Kulatunga 1c59b3c245 fix tests. 2020-09-21 19:24:39 -06:00
Jason KulatungaandGitHub 119e24f6ec Merge pull request #41 from AnalogJ/ext_logging 
adding new environmental variables for added debugging: COLLECTOR_LOG…
 2020-09-21 19:04:29 -06:00
Jason Kulatunga a57120d600 adding new environmental variables for added debugging: COLLECTOR_LOG_FILE, COLLECTOR_DEBUG, DEBUG, SCRUTINY_LOG_FILE, SCRUTINY_DEBUG 2020-09-21 18:41:52 -06:00
Jason Kulatunga f2dd87cf82 dont use a go-routine -- disable concurrency. 2020-09-21 09:59:52 -06:00
Jason Kulatunga 8b139ad157 remove concurrency for collector, it causes issues on systems with lots of devices. Just retrieve the data in order for now (eventually we may do it in batches). 2020-09-21 08:44:50 -06:00
Jason Kulatunga 286ec25a94 (0.2.0) Automated packaging of release by Packagr 
Signed-off-by: Jason Kulatunga <jason@thesparktree.com>
 2020-09-21 03:15:05 +00:00
Jason KulatungaandGitHub 211fe7843a Update issue templates 2020-09-20 21:00:52 -06:00
Jason KulatungaandGitHub d6fad90fa4 Merge pull request #38 from AnalogJ/smartctl_scan 
Smartctl scan
 2020-09-20 20:42:26 -06:00
Jason Kulatunga fd82e9a4da print error message if publish does not finish successfully. 2020-09-20 17:37:43 -06:00
Jason Kulatunga ad3f8480d9 added some anonymized nvme test data to ensure that NVMe drives are correctly processed by new device detection. thanks @Roxedus. 
All db testing is done with files created in a temp directory.
 2020-09-20 17:37:43 -06:00
Jason Kulatunga 297f0a51c5 adding ability to write a log file with all output from collector. Executing commands will now log be logged (and when debug is enabled, their output's are also logged). 2020-09-20 17:37:43 -06:00
Jason Kulatunga 67d1c592a5 include the device type in the title, if it's non-standard. 2020-09-20 17:37:43 -06:00
Jason Kulatunga 24262f7c8c pass deviceType when running smartctl data collection (for megaraid type disks). 
Make DevicePrefix a public function available outside the detect module.
if device type is detected as "ata" or "scsi", dont pass in via -d parameter, can cause issues with missing data.
 2020-09-20 17:37:43 -06:00
Jason Kulatunga 66122778a3 only the firmware can really change between scans. Lets slim down the metadata update. 2020-09-20 17:37:43 -06:00
Jason Kulatunga 3deca46851 fix. 2020-09-20 17:37:43 -06:00
Jason Kulatunga 23d5b86b1b new device detection engine (OS aware). Uses smartctl --scan to detect drives (and conditionally uses jaypipes/ghw). WWN is calculated from smartctl data, then retrieved from GHW, and fallsback to serial number. WWN calcuation code is based on IEEE spec, for "Registered" IEEE format - NAA5. TODO: support NAA6 and other formats? 2020-09-20 17:37:43 -06:00
Jason Kulatunga f53833d617 add codecov badge. 2020-09-20 16:51:36 -06:00
Jason Kulatunga fab1e3c624 fix the coverage file path. 2020-09-20 16:28:38 -06:00
Jason Kulatunga a55f3acacf generate a coverage.txt file, and upload to codecov.io. 2020-09-20 16:24:30 -06:00
Jason KulatungaandGitHub 853b1a7249 Merge pull request #28 from AnalogJ/notify_failures 
Adding UI for settings (and eventually notifications).
 2020-09-18 14:44:24 -06:00
Jason Kulatunga a7cd912318 dont ignore NVME storage controllers. 2020-09-18 10:43:14 -06:00
Jason Kulatunga e6eeaf7e31 adding mocked detail data for frontend viewing. placeholders for settings panels. Add dialog panel for Details setings. 2020-09-18 10:14:19 -06:00
Jason Kulatunga 5101a37964 adding device protocl and type to the. Adding class for parsing smartctl --scan json output, for device detection. added an example/test file for smartctl -x -j added a placeholder settings panel. moved dashboard & details compoonent out of "Admin" directory. 2020-09-18 10:14:19 -06:00
Jason Kulatunga 98415e625d fix import. added simle test for notify test endpoint. 2020-09-18 10:14:19 -06:00
Jason Kulatunga 78a619b09d moved middleware into more relevant location. Adding send test notifications handler. making sure that config is available from web handler functions. 2020-09-18 10:13:06 -06:00
Jason Kulatunga c913cf39b9 adding new nottification validation erorr. Added a notification class containing webhook, script and shoutrrr notification logic. Adding "Test notification endpoint". 2020-09-18 10:13:06 -06:00
Jason Kulatunga 6bee0d1489 don't build a docker image and attach to the release. Scrutiny is public now, images hosted on docker-hub. 2020-09-18 10:06:33 -06:00
Jason Kulatunga cadf055105 add license and logo link. 2020-09-18 09:58:57 -06:00
Jason Kulatunga 1acd7e0d47 badges 2020-09-18 09:45:11 -06:00
Jason Kulatunga 266c95f857 fix #3 
Make sure that the collector attempts to correctly communicate with webapp container, even when running in dedicated container (and triggered manually).
fixes cron schedule to run daily.
added instructions for dedicated containers.
 2020-09-18 09:23:39 -06:00
Jason KulatungaandGitHub 458eaf2726 Merge pull request #1 from RealOrangeOne/patch-1 
Fix scrutiny binary location
 2020-09-17 08:45:03 -07:00
Jason Kulatunga 62b2ec9554 (0.1.13) Automated packaging of release by Packagr 
Signed-off-by: Jason Kulatunga <jason@thesparktree.com>
 2020-09-17 03:24:22 +00:00
Jason Kulatunga 0c85f65ebb typos. 2020-09-16 18:56:39 -07:00
Jason Kulatunga 373e3e335c add thankyou comment to README. 2020-09-16 18:42:58 -07:00
Jason Kulatunga a4a8cc7b79 update readme docs. 2020-09-16 18:27:44 -07:00
Jason Kulatunga f40b8d0c53 fix Docker command in CONTRIBUTING.md 2020-09-16 18:21:29 -07:00
Jason Kulatunga fa33b00826 fix Github Actions after move. 2020-09-16 18:19:47 -07:00
Jason Kulatunga 6e6c9b7251 fix dockerfile. 2020-09-16 18:13:06 -07:00
Jason Kulatunga b44b052f81 fix copy. 2020-09-16 18:03:35 -07:00
Jason Kulatunga 14d733e9cc move docker files & eventually docker-compose files into 'docker' directory. 2020-09-16 18:03:02 -07:00
Jason Kulatunga 5c9ed3ba22 update LICENSE section. 2020-09-16 17:57:42 -07:00
Jason Kulatunga 1def7d334c add image to readme. 2020-09-16 17:55:36 -07:00
Jason Kulatunga e43048feae only run CI on pushes. 2020-09-08 22:41:44 -07:00
Jason Kulatunga 834dcdc223 update test db. 2020-09-08 22:40:08 -07:00
Jason Kulatunga c8471ffa88 (0.1.12) Automated packaging of release by Packagr 
Signed-off-by: Jason Kulatunga <jason@thesparktree.com>
 2020-09-09 05:34:03 +00:00
Jason KulatungaandGitHub ea9e7ec218 Merge pull request #46 from AnalogJHQ/scsi_nvme_ui 
added ideal and thresholds for NVMe and SCSI drives.
 2020-09-08 22:30:42 -07:00
Jason Kulatunga 86fc10b7b9 added ideal and thresholds for NVMe and SCSI drives. 
Added functions (PopulateAttributeStatus) to ensure that NVME and SCSI drives set the status for SMART attributes.
Moved Status populating fucntion into the *Attribute files, so they are closer to the code they actually interact with.
Fix frontend to correctly display status, thresh and Ideal for NVMe and SCSI ddrives.
 2020-09-08 22:24:24 -07:00
Jason Kulatunga fb1415f8a5 (0.1.11) Automated packaging of release by Packagr 
Signed-off-by: Jason Kulatunga <jason@thesparktree.com>
 2020-09-07 15:47:30 +00:00
Jason Kulatunga 2ca6213fa5 fix release docker. 2020-09-07 08:44:46 -07:00
Jason Kulatunga 022b6b6598 (0.1.10) Automated packaging of release by Packagr 
Signed-off-by: Jason Kulatunga <jason@thesparktree.com>
 2020-09-07 15:39:06 +00:00
Jason Kulatunga 9a053357fa trying to fix automated release. 2020-09-07 08:36:17 -07:00
Jason Kulatunga 09eca64a03 (0.1.9) Automated packaging of release by Packagr 
Signed-off-by: Jason Kulatunga <jason@thesparktree.com>
 2020-09-07 15:26:16 +00:00
Jason Kulatunga e111374c1b Merge remote-tracking branch 'origin/master' 2020-09-07 08:23:34 -07:00
Jason Kulatunga 0eb96bdae1 trying to fix docker-release trigger. 2020-09-07 08:23:23 -07:00
Jason Kulatunga 442cda254c (0.1.8) Automated packaging of release by Packagr 
Signed-off-by: Jason Kulatunga <jason@thesparktree.com>
 2020-09-07 15:19:26 +00:00
Jason Kulatunga abfb0a2612 add a name to release-docker.yaml workflow. 2020-09-07 08:15:39 -07:00
Jason Kulatunga 451bf73334 (0.1.7) Automated packaging of release by Packagr 
Signed-off-by: Jason Kulatunga <jason@thesparktree.com>
 2020-09-07 15:10:48 +00:00
Jason Kulatunga dd51451425 cleanup old artifacts from CI. 2020-09-07 07:47:35 -07:00
Jason Kulatunga 5c77c82156 tweaking release pipeline 2020-09-06 17:17:16 -07:00
Jason Kulatunga 329446869b tweaking release pipeline to support docker-in-docker. 2020-09-06 16:26:17 -07:00
Jason Kulatunga 586767393d (0.1.6) Automated packaging of release by Packagr 
Signed-off-by: Jason Kulatunga <jason@thesparktree.com>
 2020-09-06 23:14:48 +00:00
Jason KulatungaandGitHub 390ac1d0a5 Merge pull request #44 from AnalogJHQ/notify 
Notify
 2020-09-06 16:12:09 -07:00
Jason Kulatunga 6cf341a5f1 tweaking release pipeline. 2020-09-06 16:11:04 -07:00
Jason Kulatunga 5dd3aed1fe adding threshold for percentage Used. 
Adding release pipeline.
 2020-09-06 16:06:52 -07:00
Jason Kulatunga 6ec13e48b8 WIP - describing notification syntax. 2020-08-29 16:30:30 -07:00
Jason Kulatunga c7f529ab41 fixing grid. 2020-08-29 12:22:03 -07:00
Jason Kulatunga 50f1566689 fixing grid. 2020-08-29 11:53:44 -07:00
Jason Kulatunga cef71d5ce0 run tests. 2020-08-29 01:15:08 -07:00
Jason Kulatunga 0c1cf91a90 forgot to checkout. 2020-08-29 00:49:53 -07:00
Jason Kulatunga 82e422c3e0 build docker in parallel. 2020-08-29 00:48:55 -07:00
Jason Kulatunga 887ce13c47 docker in docker? 2020-08-29 00:46:07 -07:00
Jason Kulatunga 8a4f0dc2f4 build docker image. 2020-08-29 00:41:01 -07:00
Jason Kulatunga 112590bcae fix env. 2020-08-29 00:34:13 -07:00
Jason Kulatunga f59e6bd17e archive binaries. 2020-08-29 00:31:28 -07:00
Jason Kulatunga d9de1b9cbd tweaking. 2020-08-29 00:26:32 -07:00
Jason Kulatunga 4610247207 fix. 2020-08-29 00:15:42 -07:00
Jason Kulatunga b7e6281f83 tweaking github actions. 2020-08-29 00:14:22 -07:00
Jason Kulatunga bf6387ebf4 hello world github action. 2020-08-29 00:00:09 -07:00
Jason KulatungaandGitHub cfac276941 Merge e283d43654 into 794479b28e 2020-08-28 00:43:41 -07:00
Jason Kulatunga e283d43654 rename metadata class names. 
adding metadata for NVME and SCSI drives.
send back protocol specific metadata for displaying data in the UI for attributes.
UI - moved all metadata lookups into named functions (for better if/else logic)
show different columns if nvme or scsi.
 2020-08-28 00:41:08 -07:00
Jason Kulatunga 2ad120c87b added debug logging message for detected devices. 
adding a mocked class for Config.
Adding device type to Device struct. Will eventually be needed for raid drives.
adding End-to-end testing capabilties.
Added testdata json files for webserver requests.
Seperated Start code and Setup code in webapp so we can test.
renamed "smart_attributes" to "ata_attributes" - Backwards incomatible change.
Added front end device sorting (red, yellow, green)
show unknown icon/status if drive has no smart data yet.
Moved all attribute "getters" into the controller.
created a device-sort pipe.
 2020-08-26 21:35:13 -07:00
Jason Kulatunga 5a80ae3e74 WIP - start supporting NVME and SCSI drive smart data. 
Added addiitonal log message data for Smartctl exit ccode.
 2020-08-24 23:01:03 -07:00
Jason KulatungaandGitHub 996437b412 Merge a08e1457c4 into 92d54df022 2020-08-23 00:45:02 +00:00
Jason Kulatunga a08e1457c4 upadte packggr. 2020-08-22 17:35:30 -07:00
Jason Kulatunga f7b2a7b41b make sure results from failing smartctl execution is still sent to API. 2020-08-22 17:27:44 -07:00
Jason Kulatunga 92d54df022 adding test files. 2020-08-21 21:14:25 -07:00
Jason Kulatunga d636709aa1 Moved version file into webapp source tree. Replacing fmt with logger calls. moved Jobber config file into /scrutiny/jobber directory. Added scsi json file. Moved API rooute handlers into their own files in a module. Added not yet implemnented tooltips. 2020-08-21 18:06:00 -07:00
Jason Kulatunga c14f313fa1 check array length. 2020-08-21 00:22:56 -07:00
Jason Kulatunga fa5a2381cc update README with new instructions. 2020-08-20 23:52:11 -07:00
Jason KulatungaandGitHub 2259f11771 Merge ff904542a9 into b6ca94f786 2020-08-20 23:37:50 -07:00
Jason Kulatunga ff904542a9 cleanup build artifacts. 2020-08-20 23:36:22 -07:00
Jason KulatungaandGitHub 7a10a7ee63 Merge a78e4eb001 into 29b5b53189 2020-08-20 23:27:20 -07:00
Jason Kulatunga a78e4eb001 fix failing test. 2020-08-20 23:27:07 -07:00
Jason Kulatunga f9e41cd6a2 disable linter. 2020-08-20 23:19:52 -07:00
Jason Kulatunga 0f9ee840ef integrating packagr. 2020-08-20 23:03:18 -07:00
Jason Kulatunga 29b5b53189 added a empty landing page. 2020-08-20 21:18:02 -07:00
Jason Kulatunga 5c2b0a8e6b changed command to use /run/udev in read-only mode. 2020-08-20 20:34:02 -07:00
Jason Kulatunga e0fd56f0f1 remove s6-overlay from individual docker images. 2020-08-20 20:23:14 -07:00