steve/go-extractor
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
55 Commits 1 Branch 0 Tags
fca50a47c36c0e5388367e1192b06b016229d65c
Commit Graph

5 Commits

Author SHA1 Message Date
Steve Dudenhoeffer
a12c9f7cb6 fix: propagate errors from DuckDuckGo search and GetResults
Some checks failed
CI / test (pull_request) Failing after 6m12s
Details
CI / vet (pull_request) Failing after 6m12s
Details
CI / build (pull_request) Failing after 6m15s
Details 
- Change SearchPage.GetResults() to return ([]Result, error) so ForEach
  errors are no longer silently discarded
- Fix Search() to return the ForEach error instead of nil
- Update cmd caller to check GetResults() errors

Closes #5, #6

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-15 16:16:04 +00:00
Steve Dudenhoeffer
cb2ed10cfd refactor: restructure API, deduplicate code, expand test coverage
Some checks failed
CI / build (push) Failing after 2m4s
Details
CI / test (push) Failing after 2m6s
Details
CI / vet (push) Failing after 2m19s
Details 
- Extract shared DeferClose helper, removing 14 duplicate copies
- Rename PlayWright-prefixed types to cleaner names (BrowserOptions,
  BrowserSelection, NewBrowser, etc.)
- Rename fields: ServerAddress, RequireServer (was DontLaunchOnConnectFailure)
- Extract shared initBrowser/mergeOptions into browser_init.go,
  deduplicating ~120 lines between NewBrowser and NewInteractiveBrowser
- Remove unused locator field from document struct
- Add tests for all previously untested packages (archive, aislegopher,
  wegmans, useragents, powerball) and expand existing test suites
- Add MIGRATION.md documenting all breaking API changes

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-09 13:59:47 -05:00
Steve Dudenhoeffer
39453288ce Add OpenSearch and SearchPage functionality for DuckDuckGo 
Introduced the `OpenSearch` method and `SearchPage` interface to streamline search operations and allow for loading more results dynamically. Updated dependencies and modified the DuckDuckGo CLI to utilize these enhancements.
 2025-03-18 02:42:50 -04:00
Steve Dudenhoeffer
e8de488d2b Update CSS selector for extracting titles in DuckDuckGo parser 
Replaced the overly complex CSS selector with a simplified "h2" selector for extracting titles. This change improves maintainability and ensures accurate title extraction from the updated DOM structure.
 2025-01-16 21:37:38 -05:00
Steve Dudenhoeffer
67a3552747 Add DuckDuckGo integration for search functionality 
Implemented a DuckDuckGo search module with configurable SafeSearch and regional settings. Added a CLI tool to perform searches via DuckDuckGo using browser automation, supporting flags for customization.
 2025-01-16 20:45:37 -05:00