Summary

Adds basic agent mode.

Read #79 for a full description of changes.

Read #78 for a full description of changes.

Read #77 for full description of changes.

Read #75 for full description of changes

Read #68 for full description.

Selenium to Playwright Rewrite:

• Migrates from Selenium to Playwright for handling browser automation and scraping tasks.
• Removes Selenium-specific code and dependencies.
• Adds Playwright integration, including proxy handling, asynchronous scraping, and media collection.

UI Fixes:

• Updates navigation labels (e.g., "Previous Jobs" -> "Jobs").
• Improves styling for various UI components, including scrollbars and login prompts.
• Refines the user interface in CronJobs and Statistics pages for better theme support and responsiveness.

Code Cleanup:

• Deletes unused log-related components and files.
• Optimizes Docker setup by reducing unnecessary steps and dependencies.

Summary

Adds job completion notifications and refactors parts of the codebase for better maintainability.

Changes

• Notifications:
  • Support for email and Discord notifications on job completion.
  • Configurable via environment variables.
• Refactoring:
  • Centralized logging in logger.py.
  • Cleaned up imports and redundant code in job_worker.py.
• Frontend:
  • Improved URL-based search handling in JobTable.
• Fixes:
  • Fixed handling of empty proxies in parse-job-options.ts.

Environment Variables

• Notification-related variables:
  • NOTIFICATION_CHANNEL, NOTIFICATION_WEBHOOK_URL, SCRAPERR_FRONTEND_URL.
• Email-specific variables:
  • EMAIL, TO, SMTP_HOST, SMTP_PORT, SMTP_USER, SMTP_PASSWORD, USE_TLS.

Summary

Introduces functionality to conditionally disable user registration based on the REGISTRATION_ENABLED environment variable. When registration is disabled, a default user is automatically created if credentials are provided.

🔐 Registration Check API

• Added /auth/check endpoint to expose REGISTRATION_ENABLED value to the frontend.

🛠️ Startup Logic

• On startup, the backend checks for required default user credentials:
  • DEFAULT_USER_EMAIL
  • DEFAULT_USER_PASSWORD
  • DEFAULT_USER_FULL_NAME
• If registration is disabled and any of these are missing, the app will log an error and exit.

✅ Frontend Integration

• Merged AI and auth check responses into a single /api/check endpoint.
• Updated login form UI to reflect the registration status:
  • Hides the "Sign up" button when registration is disabled.
  • Displays a message indicating that registration is not available.

🧹 Minor Fixes

• Improved response format for AI availability check:
  GET /api/ai/check now returns { ai_enabled: true/false }.
• Moved and renamed API route for better organization and frontend access.

🐛 Fix "Invalid Date" Issue in AI Job Menu Dropdown

Summary

This PR fixes Issue #59, where the AI job selection dropdown was showing blank entries with the tooltip "Invalid Date" despite jobs completing successfully.

✅ Fix Details

• Corrected the logic that supplies job data to the AI chat interface.
• Ensured the correct job reference is passed when rendering the dropdown options.
• Verified that job metadata, including dates and names, now display as expected.