Debian Codegraph @

features/logging.setup_level.feature

raw
1 Feature: Setup logging_level
2
3 As a tester
4 I want to configure the logging_level for --logcapture mode
5 So that I see only the important log-records when a scenario fails.
6
7 As a tester
8 I want to configure the logging_level for --nologcapture mode
9 So that I see only the important log-records up to this level.
10
11 . SPECIFICATION:
12 . * logging_level can be defined on command-line
13 . * logging_level can be defined in behave configuration file
14 . * logging_level should be applied in before_all() hook in --nologcapture mode
15
16
17 @setup
18 Scenario: Feature Setup
19 Given a new working directory
20 And a file named "features/steps/use_behave4cmd_steps.py" with:
21 """
22 import behave4cmd0.log.steps
23 import behave4cmd0.failing_steps
24 import behave4cmd0.passing_steps
25 """
26 And a file named "features/environment.py" with:
27 """
28 def before_all(context):
29 context.config.setup_logging()
30 """
31 And a file named "features/example.log_with_failure.feature" with:
32 """
33 Feature:
34 Scenario: S1
35 Given I create log records with:
36 | category | level | message |
37 | root | ERROR | Hello1 log-error-record |
38 | root | WARN | Hello1 log-warn-record |
39 | root | INFO | Hello1 log-info-record |
40 | root | DEBUG | Hello1 log-debug-record |
41 When a step fails
42 """
43 And a file named "features/example.log_with_pass.feature" with:
44 """
45 Feature:
46 Scenario: S2
47 Given I create log records with:
48 | category | level | message |
49 | root | ERROR | Hello2 log-error-record |
50 | root | WARN | Hello2 log-warn-record |
51 | root | INFO | Hello2 log-info-record |
52 | root | DEBUG | Hello2 log-debug-record |
53 When a step passes
54 """
55
56 @capture
57 Scenario: Logcapture mode: Use logging_level on command-line
58
59 Also ensure that command-line option can override configuration file info.
60
61 Given a file named "behave.ini" with:
62 """
63 [behave]
64 logging_level = INFO
65 """
66 When I run "behave -f plain -T --logging-level=WARN features/"
67 Then it should fail with:
68 """
69 1 scenario passed, 1 failed, 0 skipped
70 3 steps passed, 1 failed, 0 skipped, 0 undefined
71 """
72 And the command output should contain:
73 """
74 Captured logging:
75 ERROR:root:Hello1 log-error-record
76 WARNING:root:Hello1 log-warn-record
77 """
78 But the command output should not contain the following log records:
79 | category | level | message | Comment |
80 | root | INFO | Hello1 log-info-record | Log-level too low |
81 | root | DEBUG | Hello1 log-debug-record | Log-level too low |
82 | root | ERROR | Hello2 log-error-record | Scenario passes, capture log is suppressed |
83 | root | WARN | Hello2 log-warn-record | Scenario passes, capture log is suppressed |
84 | root | INFO | Hello2 log-info-record | Scenario passes, capture log is suppressed |
85 | root | DEBUG | Hello2 log-debug-record | Scenario passes, capture log is suppressed |
86
87
88 @capture
89 Scenario: Logcapture mode: Use logging_level in configuration file
90 Given a file named "behave.ini" with:
91 """
92 [behave]
93 logging_level = ERROR
94 """
95 When I run "behave -f plain -T features/"
96 Then it should fail with:
97 """
98 1 scenario passed, 1 failed, 0 skipped
99 3 steps passed, 1 failed, 0 skipped, 0 undefined
100 """
101 And the command output should contain:
102 """
103 Captured logging:
104 ERROR:root:Hello1 log-error-record
105 """
106 But the command output should not contain the following log records:
107 | category | level | message | Comment |
108 | root | WARN | Hello1 log-warn-record | Log-level too low |
109 | root | INFO | Hello1 log-info-record | Log-level too low |
110 | root | DEBUG | Hello1 log-debug-record | Log-level too low |
111 | root | ERROR | Hello2 log-error-record | Scenario passes |
112 | root | WARN | Hello2 log-warn-record | Scenario passes |
113 | root | INFO | Hello2 log-info-record | Scenario passes |
114 | root | DEBUG | Hello2 log-debug-record | Scenario passes |
115
116
117 @no_capture
118 Scenario: Normal mode: Use logging_level on command-line
119 Given a file named "behave.ini" with:
120 """
121 [behave]
122 logging_level = INFO
123 """
124 When I run "behave -f plain -T --logging-level=WARN --no-logcapture features/"
125 Then it should fail with:
126 """
127 1 scenario passed, 1 failed, 0 skipped
128 3 steps passed, 1 failed, 0 skipped, 0 undefined
129 """
130 And the command output should contain the following log records:
131 | category | level | message |
132 | root | ERROR | Hello1 log-error-record |
133 | root | WARN | Hello1 log-warn-record |
134 | root | ERROR | Hello2 log-error-record |
135 | root | WARN | Hello2 log-warn-record |
136 But the command output should not contain the following log records:
137 | category | level | message | Comment |
138 | root | INFO | Hello1 log-info-record | Log-level too low |
139 | root | DEBUG | Hello1 log-debug-record | Same reason |
140 | root | INFO | Hello2 log-info-record | Same reason |
141 | root | DEBUG | Hello2 log-debug-record | Same reason |
142
143 @no_capture
144 Scenario: Normal mode: Use logging_level in configuration file
145 Given a file named "behave.ini" with:
146 """
147 [behave]
148 log_capture = false
149 logging_level = ERROR
150 """
151 When I run "behave -f plain -T features/"
152 Then it should fail with:
153 """
154 1 scenario passed, 1 failed, 0 skipped
155 3 steps passed, 1 failed, 0 skipped, 0 undefined
156 """
157 And the command output should contain the following log records:
158 | category | level | message |
159 | root | ERROR | Hello1 log-error-record |
160 | root | ERROR | Hello2 log-error-record |
161 But the command output should not contain the following log records:
162 | category | level | message | Comment |
163 | root | WARN | Hello1 log-warn-record | Log-level too low |
164 | root | INFO | Hello1 log-info-record | Same reason |
165 | root | DEBUG | Hello1 log-debug-record | Same reason |
166 | root | WARN | Hello2 log-warn-record | Same reason |
167 | root | INFO | Hello2 log-info-record | Same reason |
168 | root | DEBUG | Hello2 log-debug-record | Same reason |