steve/go-extractor
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
88 Commits 1 Branch 0 Tags
e94665ff25020521143431fe2ecc0c2261e79bc9
Commit Graph
6 Commits
Author SHA1 Message Date
steveandClaude Opus 4.6 e94665ff25 feature: add stealth mode, launch args, and init scripts to BrowserOptions
CI / vet (pull_request) Successful in 1m18s
Details
CI / build (pull_request) Successful in 1m22s
Details
CI / test (pull_request) Successful in 1m28s
Details 
Add anti-bot-detection evasion support to reduce blocking by sites like
archive.ph. Stealth mode is enabled by default for all browsers and applies
common evasions: navigator.webdriver override, plugin/mimeType spoofing,
window.chrome stub, and outerWidth/outerHeight fixes. For Chromium,
--disable-blink-features=AutomationControlled is also added.

New BrowserOptions fields:
- Stealth *bool: toggle stealth presets (default true)
- LaunchArgs []string: custom browser launch arguments
- InitScripts []string: JavaScript injected before page scripts

Closes #56

Co-Authored-By: Claude Opus 4.6 <[email protected]>
 2026-02-17 20:10:58 +00:00
steveandClaude Opus 4.6 097b2e12c7 fix: consolidate user-agent strings into DefaultUserAgent constant
CI / build (pull_request) Successful in 44s
Details
CI / test (pull_request) Successful in 46s
Details
CI / vet (pull_request) Successful in 1m28s
Details 
Define DefaultUserAgent (Firefox/147.0) in playwright.go and reference
it from NewBrowser, NewInteractiveBrowser, and CLI flags. Previously
three different UA strings existed (two at 142.0, one outdated at 133.0).

Closes #17

Co-Authored-By: Claude Opus 4.6 <[email protected]>
 2026-02-15 16:24:44 +00:00
steveandClaude Opus 4.6 328455de32 fix: ShowBrowser merge behavior and consistent browser defaults
CI / vet (pull_request) Successful in 1m49s
Details
CI / build (pull_request) Successful in 1m51s
Details
CI / test (pull_request) Successful in 1m52s
Details 
- Change ShowBrowser from bool to *bool so nil means "don't override"
  in mergeOptions(), fixing the bug where it always overwrote the base
- Add Bool() helper for convenient *bool construction
- Align NewInteractiveBrowser default from Chromium to Firefox to match
  NewBrowser
- Update README example and CLI flags for the *bool change

Closes #15, #16

Co-Authored-By: Claude Opus 4.6 <[email protected]>
 2026-02-15 16:22:49 +00:00
steveandClaude Opus 4.6 cb2ed10cfd refactor: restructure API, deduplicate code, expand test coverage
CI / build (push) Failing after 2m4s
Details
CI / test (push) Failing after 2m6s
Details
CI / vet (push) Failing after 2m19s
Details 
- Extract shared DeferClose helper, removing 14 duplicate copies
- Rename PlayWright-prefixed types to cleaner names (BrowserOptions,
  BrowserSelection, NewBrowser, etc.)
- Rename fields: ServerAddress, RequireServer (was DontLaunchOnConnectFailure)
- Extract shared initBrowser/mergeOptions into browser_init.go,
  deduplicating ~120 lines between NewBrowser and NewInteractiveBrowser
- Remove unused locator field from document struct
- Add tests for all previously untested packages (archive, aislegopher,
  wegmans, useragents, powerball) and expand existing test suites
- Add MIGRATION.md documenting all breaking API changes

Co-Authored-By: Claude Opus 4.6 <[email protected]>
 2026-02-09 13:59:47 -05:00
steve 868acfae40 Add context support to Playwright browser initialization 
Refactored Playwright initialization to ensure context propagation. Updated `NewPlayWrightBrowser` and related methods to accept `context.Context` for better cancellation and timeout handling. Improved error resilience and concurrency during browser setup.
 2025-10-28 00:24:19 -04:00
steve 567a9f9212 added archive, megamillions, and powerball site logic 2024-12-23 03:18:50 -05:00